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ABSTRACT 


This  thesis  develops  statistical  techniques  -for 
determining  Air  Force  officer  separations  and  retirements. 
^The  primary  source  of  historical  loss  information  is  the 
Fiscal  Year  Computerized  Officer  Projection  Systeri  report. 
The  analysis  techniques  used  were  linear  regression  and  Box 
and  Jenkins7  time  series. 

The  regression  models  developed  for  both  separation 
and  retirement  predictions  were  very  accurate.  The  FY81 
separation  prediction  was  in  error  by  only  1.8%  and  the 
FY82  separation  and  retirement  predictions  were  in  error  by 
16.9%  and  2.1%  respectfully.  Moreover,  a  modified  update 
procedure  was  in  error  by  only  9.6V.  for  the  FY82  separation 
prediction.  This  compares  to  errors  in  loss  predictions  of 
1.7%  to  79.9%  for  the  currently  used  models^  The 
independent  variables  used  were  separation  and  retirement 
applications  approved  and  in-system.  The  R*ranged  from  .75 
to  .99  for  all  data  bases  used  in  this  study. 

Although  time  domain  time  series  models  were  developed 
which  adequately  fit  both  separation  and  retirement 
patterns,  both  failed  to  accurately  predict  either  short  or 

long  term  trends.  The  inadequacies  of  these  time  series 

—  v- 

models  might  be  remedied  by  the  development  of  an  index  of 
leading  indicators  or  the  removal  of  long  term  trends  by  a 


frequency  domain  analysis. 
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STATISTICAL  TECHNIQUES  FOR  DETERMINING  OFFICER  SEPARATION 


AND  RETIREMENT  TRENDS  IN  THE  UNITED  STATES  AIR  FORCE 

I .  Introduct i on 

The  ability  to  accurately  predict  both  separation  and 
retirement  trends  is  a  necessity  inherent  in  all  aspects  of 
Air  Force  Personnel  Management.  This  thesis  effort 
examines  the  trends  associated  with  Air  Force  Officer 
separations  and  retirements  and  then  attempts  to  predict 
these  trends  for  both  the  short  and  long  term  needs  of 
personnel  management.  As  will  be  discussed  later, 
currently  used  methodologies  have  failed  to  accurately 
predict  losses  so  that  their  estimates  have  precipitated 
the  adoption  of  numerous  personnel  actions  which  were 
required  to  bring  strength  levels  in  line  with 
Congressional  limits.  Therefore,  this  research  effort 
focused  its  attention  on  an  alternative  methodology  which 
would  have  significantly  improved  loss  projections. 

As  noted  above,  the  requirement  for  accurate  loss 
projecting  is  vital  to  Air  Force  Personnel  Management. 
Each  branch  of  the  DOD  is  restricted  by  public  law  to  be  at 
or  below  an  authorized  strength  level  at  2400  hours  on  30 
September  of  each  fiscal  year.  However,  just  as  the  Air 
Force  is  constrained  to  a  maximum  strength  level,  it  also 


attempts  to  come  as  close  as  possible  to  its  authorized 
%  ceiling  in  order  to  meet  mission  requirements.  Therefore, 

management  must  continually  strive  to  obtain  accurate  loss 
projections  with  as  much  lead  time  as  possible  so  that  an 
adequate  time  span  is  available  for  both  the  recruiting  and 
trainirg  of  needed  replacements. 

Background 

Since  the  end  of  the  Vietnam  conflict,  large 
fluctuations  in  both  our  authorized  strength  level  and  loss 
rates  have  caused  Air  Force  management  to  enact  numerous 
policies,  many  of  which  were  very  unpopular  to  Air  Force 
personnel.  One  of  the  most  odious  management  acts  ever 
„  adopted  was  the  Reduction  in  Force  (RIF)  action  which 

occurred  in  the  mid-1970's.  However,  this  was  only  the 
beginning  of  what  was  to  be  a  very  turbulent  period  for 
strength  management. 

Over  the  last  half  decade,  two  primary  models  have 
been  developed  for  projecting  Air  Force  Officer  retirements 
and  separations.  The  primary  model  in  use  today  is  the  Air 
Force  Computerized  Officer  Projecting  System  (AFCOPS) . 
This  model  is  used  for  projecting  the  next  two  fiscal  years 
of  losses  (Ref  1).  Another  model,  which  is  called  the 
Oefense  Officer  Personnel  Management  System  (DOPMS),  is  a 
dynamic  computerized  model  which  was  designed  to  project 
losses  throughout  the  Five  Year  Defense  Plan  (FYDP)  (Ref 
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1).  A  complete  discussion  of  each  of  these  models  -follows. 

The  AFCOPS  model,  «s  mentioned  above,  is  a 
computerized  model  for  projecting  Air  Force  Officer  losses. 
Using  either  one  or  two  year  loss  statistics,  this  model 
divides  losses  into  categories  where  the  personal 
attributes  of  everyone  in  a  given  category  or  cell  are 
identical.  Such  a  category  may  be  comprised  of  all  pilots 
that  are  married,  have  one  dependent,  have  completed  a 
masters  degree  program,  are  ROTC  graduates,  and  have  seven 
years  of  total  active  commissioned  service.  Once  the 
historical  loss  data  has  been  categorized  accordingly,  loss 
rates  are  calculated  by  dividing  the  number  lost  in  each 
cell  by  the  beginning  active  duty  population  in  that  cell. 
If,  for  example,  at  the  beginning  of  FY7P  there  were  1000 
individuals  in  a  particular  cell  and  250  of  those 
individuals  separated  from  the  service  during  the  next 
fiscal  year,  then  a  loss  rate  of  25K  would  be  used  to 
project  losses  for  the  next  fiscal  year.  Thus,  if  500 
individuals  were  in  this  same  loss  category  at  the 
beginning  of  FY80,  then  125  losses  would  be  projected  to 
occur . 

The  D0PMS  model  is  similar  to  the  AFCOPS  model,  except 
that  it  ages  the  force  each  year  by  adding  estimated  gains 
and  then  subtracting  the  estimated  losses  from  the 
beginning  population.  The  model  then  uses  this  number  as 
the  beginning  population  for  the  next  fiscal  year. 
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However,  the  DOPMS  model  does  not  calculate  the  loss  rates 
which  it  uses  for  predicting,  but  instead  uses  the  loss 
rates  which  are  calculated  by  the  AFCOPS  model. 

Actions  Available  to  Meet  End  Strength.  In  an  effort  to 
meet  end  strength,  recruiting  goals  and  objectives  must  be 
set  years  in  advance.  To  produce  an  officer  from  the  Air 
Force  Academy,  a  minimum  lead  time  of  four  years  is 
required;  to  produce  an  officer  from  ROTC,  a  minimum  lead 
time  of  two  years  is  required;  and,  to  produce  an  officer 
out  of  OTS,  a  lead  time  of  about  six  months  is  necessary. 
Therefore,  when  large  fluctuations  in  loss  rates  occur,  it 
becomes  increasingly  difficult  to  reduce  or  increase  our 
stretch  levels  by  varying  our  accessions.  For  these 
reasons,  if  management  is  to  offset  changing  retention 
patterns  by  adjusting  recruitment  goals,  significant  lead 
time  is  required.  However,  other  personnel  actions  are 
possible  and  have  occurred.  The  following  is  a  list  of 
personnel  actions  which  have  either  been  adopted  or 
discussed  for  possible  implementation  during  the  past  three 
fiscal  years  (Ref  1>: 

*  designates  actions  which  have  been  implemented 
within  the  last  three  fiscal  years 

1.  Separate  flight  and  tech  training  eliminees* 

2.  Increase  Palace  Chase  quotas* 

3.  Relax  miscellaneous  reason  separations* 
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4.  Ease  waiver  restrictions  for  DOS  six  month 
not i ce* 

5.  Voluntary  retirement  rollback* 

6.  Ease  DOS  withdrawal  restrictions 

7.  Suspend  retirement  continuations 

8.  Eliminate  retirement  date  withdrawals* 

9.  Permit  voluntary  separation  of  one-time 
failures  to  temporary  captain 

10.  Limit  continuation  of  non-critical  two-time 
failures  to  temporary  major* 

11.  Delay  accessing  Airmen  Education  and 
Commissioning  Program  graduates  until  the 
next  fiscal  year* 

12.  Delay  ROTC  engineer  accessions  until  the 
next  fiscal  year* 

13.  Delay  reserve  recall  pilots  until  the  next 
fiscal  year* 

14.  Suspend  all  OTS  technical  and  non-techn i cal 
accessions* 

15.  Implement  an  early  release  program 

16.  Ask  Congress  for  an  end  strength 
supplemental  * 

17.  Separate  one-time  failures  to  temporary 
maj or* 

18.  Involuntary  DOS  rollback 

19.  RIF 

20.  Cancel  the  ASCRO  program 

<Reserve  Officers  with  more  than  twenty 
years  of  active  commissioned  service) 


As  would  be  expected,  not  all  of  the  above  mentioned 
policies  have  been  implemented,  partly  due  to  the  adverse 
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publicity  which  they  would  cause  and  partly  due  to 
Congressional  approval  which  would  be  required  -for  any 
action  such  as  a  RIF  or  early  release  program.  However, 
that  is  not  to  say  that  many  o-f  the  policies  listed  above 
could  not  or  would  not  be  implemented  should  our  loss  rates 
continue  to  -fluctuate  to  the  degree  which  they  have  over 
the  last  -few  years. 

In  addition  to  the  adverse  publicity  associated  with 
many  of  these  actions,  whenever  ROTC  or  OTS  accessions  are 
utilized  as  strength  balancing  tools  (accession  dates  are 
delayed  until  the  next  fiscal  year),  a  bow-wave  of  ROTC  or 
OTS  accessions  develop.  Over  the  past  several  years,  this 
number  has  grown  drastically.  Currently,  there  are  well  in 
excess  of  1000  ROTC  graduates  who  normally  would  have  been 
accessed  in  the  current  fiscal  year  (Ref  1),  but,  because 
of  strength  restrictions  and  changing  loss  trends,  are 
being  delayed  until  next  fiscal  year.  This  in  turn  results 
in  those  individuals  who  will  be  graduating  next  year 
having  to  wait  until  the  following  fiscal  year  before  they 
can  enter  active  service.  One  can  easily  imagine  the 
personal  financial  hardships  which  often  beset  those 
individuals  who  must  wait  to  enter  active  duty,  especially 
considering  the  difficulty  associated  with  finding  interim 
employment  in  today's  economic  environment. 

Therefore,  it  was  in  the  area  of  loss  trend  analysis 
which  I  focused  my  attention.  I  hoped  that  by  using 


regression  analysis  to  project  short  term  (current  fiscal 
year)  losses  and  time  series  analysis  to  project  both  short 
and  long  term  trends,  that  the  personnel  actions  which  have 
been  explored  and/or  implemented  during  the  past  decade 
could  either  be  eliminated  or  reduced  to  a  minimum. 

Thesis  Overview 

This  thesis  is  divided  into  five  primary  sections. 
The  first  section  deals  with  a  regression  analysis  of 
voluntary  separations,  while  section  two  analyzes  similar 
line  officer  voluntary  separation  rates  by  means  of  a  time 
series  analysis.  Section  three  models  Air  Force  officer 
retirement  trends  by  means  of  regression  analysis,  with 
section  four  analyzing  the  line  officer  retirement  rates  as 
a  simple  time  series.  Also,  conclusions  and 

recommendations  dealing  with  the  findings  of  each  section 

are  noted  at  the  end  of  that  section.  Finally,  the  last 

) 

section  summarizes  all  of  the  conclusions  and 
recommendations  which  were  considered  significant. 


II 


Repression  Analysis  of  Separation  Application  Patterns 


Nethodol oqy 

A  simple  stepwise  multiple  linear  regression  program, 
or  more  specifically  the  Statistical  Package  for  the  Social 
Sciences  (SPSS)  regression  package  (Ref  8),  was  used  to 
model  separation  application  trends  for  Air  Force  officer 
personnel.  Date  of  Separations  (DOS)  with  a  Separation 
Designator  (SPD)  and  DOSs  without  an  SPD  were  used  as  the 
independent  variables.  Accomplished  losses  by  month  were 
used  as  the  dependent  variable.  Normally,  DOSs  with  an  SPD 
are  defined  as  officer  career  separations  (officers  who 
separate  more  than  one  year  after  the  end  of  their  initial 
obligations),  while  DOSs  without  an  SPD  are  officers  which 
are  eligible  to  separation  immediately  following  or  within 
one  year  after  completion  of  initial  obligation.  Initial 
obligation  ranges  from  four  years  for  non-rated  officers  to 
seven  years  for  rated  officers  (pilots  and  navigators). 

The  primary  source  of  loss  information  used  in  each 
data  base  is  the  Fiscal  Year  Computerized  Officer 
Projection  System  (FYCOPS)  Report.  This  report,  which  is 
produced  at  the  end  of  each  month  at  the  Air  Force  Manpower 
and  Personnel  Center  (AFMPC) ,  was  originally  designed  to 
facilitate  the  tracking  and  control  of  normal  separations 
and  retirements  as  well  as  management-controlled  loss 


programs  such  as  7-Day  Option,  Early  Release,  and  Palace 
Chase.  Examples  of  pages  from  this  report  used  for  this 
thesis  are  contained  in  Appendix  A. 

Data  Base  Configuration 

The  data  base  for  projecting  current  FY  losses  is 
comprised  of  twelve  subfiles,  each  containing  historical 
data  pertaining  to  separation  application  patterns  for  a 
given  number  of  months  prior  to  the  month  in  which  the 
losses  actually  occurred.  A  listing  of  these  files, 
labeled  SEP1  through  SEP12,  can  be  found  in  Appendix  B.  As 
can  be  seen  in  the  appendix,  each  file  is  comprised  of 
three  columns.  The  number  in  the  first  column  is  the 
dependent  variable  accomplished  losses,  with  the  numbers  in 
the  two  following  columns  corresponding  to  the  independent 
variables  DOS  without  an  SPD  and  DOS  with  an  SPD. 

In  order  to  more  fully  explain  the  composition  of 
these  files,  an  example  is  presented.  Individuals  are 
required  by  Air  Force  policy  to  submit  an  application  for 
separation  at  least  180  days  prior  to  their  desired 
separation  date,  barring  unforeseen  hardship,  medical  or 
other  special  circumstance.  This  advance  notification 
requirement  is  therefore  the  foundation  to  the  data  bases' 
design.  An  examination  of  SEP3's  first  entry,  *274  14 6 
234"  signifies  that  in  July  1979,  274  separations  occurred, 
and  that  three  months  prior  to  July  1979,  there  were  234 


approved  career  separations  in-system  and  146  other 
off  icers  who  were  scheduled  to  complete  their  initial 
obligations  in  the  month  of  July,  but  had  not  yet  notified 
AFMPC  as  to  their  separation  intentions. 

As  noted,  an  Air  Force  officer  is  required  to  submit 
an  application  for  DOS  at  least  180  days  prior  to  a 
requested  separation  date.  However,  prior  to  March  1979, 
only  90  days  notification  was  required.  Therefore,  due  to 
the  impact  which  this  policy  change  had  on  application 
trends,  each  data  base's  observations  have  been  restricted 
to  only  those  separation  actions  which  have  occurred  since 
May  1979. 


Regression  Results 

All  preliminary  analyses  were  accomplished  on  AFIT's 
Cyber  computer  using  the  SPSS  Regression  package.  A  copy 
of  each  data  base's  SPSS  listing  is  in  Appendix  C.  The 
initial  results  were  impressive.  Using  data  as  of  May 
1982,  the  R1  statistic  ranged  from  .99  for  one  month  out 
<SEP1)  to  .75  for  twelve  months  out  (SEP12).  The  R* 
statistic  measures  the  proportionate  reduction  of  tota1 
variation  in  the  dependent  variable  associated  with  the  use 
of  the  set  of  independent  variables.  An  Rl  of  one  exists 
when  all  observations  fall  directly  on  the  fitted  response 
surface.  Also,  because  an  R*  value  of  one  will  always  be 
obtained  whenever  the  number  of  independent  variables 
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equals  the  number  o f  observations,  an  adjusted  R*  is 
sometimes  used.  In  essence,  the  adjusted  R4  recognizes  the 
number  of  independent  variables  in  the  model  and  adjusts 
the  R1  statistic  accordingly.  In  fact,  the  adjusted  R4  may 
actually  become  smaller  when  another  independent  variable 
is  introduced  into  the  model  because  the  decrease  in  the 
Error  Sum  of  Squares  <SSE>  may  be  more  than  offset  by  the 
loss  of  a  degree  of  freedom  in  the  denominator.  A  summary 
listing  of  both  Rs  and  other  major  statistics  are  in  Tables 
I  and  II. 

In  examining  the  change  in  the  adjusted  R*  across  the 
data  bases,  a  significant  decrease  after  SEP6  was  observed; 
however,  this  was  not  unexpected.  As  mentioned  earlier,  an 
individual  is  required  to  submit  a  DOS  application  180  days 
prior  to  a  requested  separation  date.  Therefore,  more 
variability  in  the  data  in  files  SEP7  through  SEP12  would 
be  expected. 

In  further  analysis  of  the  regression  results,  the  F 
statistic  was  also  found  to  show  similar  results.  This 
statistic,  which  indicates  whether  the  sample  of 
observations  being  analyzed  has  been  drawn  from  a 
population  in  which  the  multiple  correlation  is  equal  to 
zero,  ranged  from  1848  for  SEP1  to  41.4  for  SEP12. 
Comparing  these  values  to  an  F  distribution  table  indicated 
that  each  of  the  twelve  data  bases  F  statistic  was 
statistically  significant  at  the  95Z  confidence  level. 
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TABLE  I 


Regression  Summary  Statistics  (Part  A) 


FILE 

OVERALL  F 

R  SQUARE 

ADJ  R  SQUARE 

DURB I N-WAT  SON 

SEPI 

1847.991 

.99088 

.99035 

2.5129 

SEP2 

1081 .490 

.9840* 

.98309 

2.3*99 

SEP3 

*49.053 

.97594 

.97444 

2.2131 

SEP4 

375.835 

.9*309 

.95784 

2.1274 

SEP5 

2*4.352 

.94*30 

.94272 

2.8244 

SEP* 

247.9*5 

.942 96 

.9391* 

2.0599 

SEP7 

109.9*2 

.88350 

.8754* 

1 . *54* 

SEP8 

80.4*2 

.85179 

.84121 

1 .94*7 

SEP? 

133. *80 

.89311 

.88*42 

1.772* 

SEP10 

107.084 

.8735* 

.8*540 

1 .5905 

SEPI  1 

72.849 

.82925 

.81787 

1.7120 

SEPI  2 

41 .393 

.7472* 

.72921 

1 .**80 

TABLE  II 


Regression  Summary  Statistics  <Part  B> 


FILE 

VARIABLE  F 

STATISTICS 

NO.  OF  OBS. 

DOS  WITH  SPD 

DOS  W/O  SPD 

SEP1 

37 

3554.34 

57.33 

SEP2 

34 

1844.89 

49.59 

SEP3 

35 

971 .84 

44.95 

SEP4 

34 

473.45 

32.47 

SEP5 

33 

515.78 

15.98 

SEP  4 

33 

484.89 

20.04 

SEP  7 

32 

215.13 

17.40 

SEP8 

31 

159.29 

24.07 

SEP9 

35 

253.37 

32.32 

SEP10 

34 

210.57 

29.19 

SEP11 

33 

145.37 

24.59 

SEP12 

31 

82.43 

25.01 

Similarly,  the  F  statistic  associated  with  each  coefficient 
was  also  statistically  significant  at  alpha  equal  to  .05. 

Finally,  each  residual  plot  was  examined  for 
normality,  constant  variance  and  positive  autocorrelation. 
Again,  just  as  with  the  other  statistical  areas,  no 
significant  problems  were  encountered;  that  is,  the 
Durbin-Uatson  statistic  was  above  the  upper  bound  for 
positive  autocorrelation  in  all  twelve  residual  plots,  and 
a  subjective  assessment  of  the  constant  variance  and 
normality  assumptions  failed  to  detect  any  significant 
probl ems. 


Model  Testin' 


As  with  any  model,  the  testing  and  evaluation  phase  Is 
as  important  as  any  other  phase  of  model  development.  In 
order  to  accomplish  this  phase,  data  which  was  recorded 
subsequent  to  30  September  1980  was  deleted  from  the  files. 
Following  this,  all  twelve  regressions  were  reaccomplished 
with  the  final  output  being  a  month-by-month  projection  of 


expected  officer  separations  for  Fiscal  Year  1981.  Figure 
1  compares  the  FY81  predicted  losses  with  the  actual  FY81 


loss  data.  After  the  FY81  projections  were  completed,  the 
data  bases  were  updated  with  information  through  30 
September  1981  and  the  twelve  regressions  were  performed 
again  so  as  to  obtain  an  FY82  loss  prediction.  Figure  2 


compares  the  prediction  for  FY82  to  the  actual  observed 
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FIGURE  1.  FI81  Officer  Actual  Vol  Seps  vs  Prediction 
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MONTH 


K'  * 

$  ■ 

9 


i 


losses.  Although  the  FY81  estimate  was  within  2X  of  the 
actual  1683  separations,  the  FY82  prediction  was  in  error 
by  approximately  16. 9X.  Therefore,  additional  analysis  was 
made  in  an  attempt  to  offset  the  trend  which  accounted  for 
this  significant  overestimate. 

Initially,  the  additional  analysis  entailed  an 
examination  of  the  FY82  loss  prediction.  This  analysis, 
revealed  that  the  overprediction  was  not  due  to  any 
particular  month's  prediction,  but  that  it  was  due  to  a 
consistent  overprediction  for  each  month.  The  following 
table  details  these  errors: 


Table  III 


FY82  Prediction  Erors 

Month 

Pred. 

Actual 

Error 

Oct 

98 

94 

♦  4.27. 

Nov 

97 

99 

-  2.  IX 

Dec 

102 

101 

+  1.0X 

Jan 

100 

91 

♦  9.9X 

Feb 

103 

84  * 

+22. 6X 

Mar 

83 

73 

♦  13.  r/. 

Apr 

106 

76 

♦39.57. 

May 

105 

74 

♦41 .9% 

Jun 

176 

131 

+34.47. 

Jul 

105 

117 

-10. 3X 

Aug 

154 

141 

♦  9.2X 

Sep 

156 

105 

+48. 6X 

Since  no  single  month's  error  appeared  to  be  the  cause  of 
the  overprediction,  it  was  believed  that  a  change  in  the 
application  submission  pattern  may  have  occurred. 
Therefore,  the  next  phase  of  model  development  was  to 
attempt  to  identify  the  cause,  and  then  develop  a 
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modification  to  the  originally  proposed  model,  one  which 
would  capture  the  changing  application  trends. 

Model  Investigation 

Initially,  the  data  bases  contained  data  which  had 
been  compiled  since  the  DOS  application  lead  time  was 
changed  from  90  days  to  180  days,  with  the  number  of 
observations  in  each  data  base  varying  from  37  in  SEP1  to 
31  in  SEP12.  Even  though  all  the  statistics  were  within  a 
957.  confidence  test,  it  was  felt  that  data  base  size 


(number  of 

observat i ons 

recorded) 

may 

be  responsible  in 

part  for 

the  model's 

i nabi 1 i ty 

to 

capture  changing 

appl i cat  ion 

patterns. 

If  too  many 

observations  are 

recorded,  then  the  regression  analysis  technique  will  be 
slow  in  detecting  a  change  in  application  trends.  On  the 
other  hand,  if  too  few  observations  are  contained  in  the 
data  bases,  an  outlier  may  have  a  significant  undesirable 
impact  on  the  calculated  regression  equations.  In  other 
words,  because  of  the  inherent  nature  of  linear  regression 
models,  equations  derived  from  large  data  bases  will  be 
slow  in  capturing  changing  application  patterns.  In 
addition,  even  though  this  methodology  assumes  that 
consecutive  fiscal  year  patterns  are  similar,  one  can  not 
assume  that  the  application  patterns  of  years  which  are 
several  years  apart  are  similar  in  nature,.  As  economic 
and  management  policies  change,  so  can  application 
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submittal  patterns.  Therefore,  this  phase  of  model 
development  Mas  to  determine  if  a  limited  number  of 
observations  Mould  improve  the  model's  prediction  ability. 
Methodol ogy .  The  determination  of  an  optimal  number  of 

observations  Mas  divided  into  tMo  subprojects.  The  first 
Mas  to  determine  at  Mhat  number  of  observations  the 
adjusted  R*  and  the  square  root  of  the  MSE  (SPSS's  standard 
deviation)  Mould  be  optimized.  The  second  subproject  Mas 
to  ascertain  if  the  number  of  observations  in  the  data 
bases  Mould  affect  the  prediction  error  Mhich  is  associated 
Mith  each  data  base. 

Adjusted  R*  and  Standard  Deviation.  Using  data  as  of 
May  1982,  each  data  base  had  consecutive  regression  runs 
compiled  Mith  each  run  using  one  less  data  point.  The 
observation  removed  Mas  in  all  instances  the  oldest 
observation  in  the  data  base;  that  is,  initially  SEP1 
contained  all  thirty-seven  data  points,  the  oldest  data 
point  Mas  then  removed  and  the  regression  statistics 
recomputed.  This  Mas  repeated  until  only  the  most  recent 
tMelve  observations  Mere  remaining  in  SEP1 .  This  same 
methodology  Mas  then  repeated  for  the  remaining  eleven  data 
bases.  A  summary  of  each  data  base's  regression  statistics 
as  Me  11  as  a  graphical  display  of  each  data  base's  adjusted 
R*  and  standard  deviation  can  be  found  in  Appendix  D. 

As  mentioned  before,  this  phase  of  model  investigation 
Mas  designed  to  determine  an  optimal  number  of  observations 
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which  should  be  recorded  in  each  data  base.  To  accomplish 
cr  this,  an  independent  analysis  of  each  data  base's  adjusted 

R*  and  standard  deviation  was  made.  The  following  table 
summarizes  the  results  of  these  analyses: 


Table  IV 


Optimal  Data  Base  Sizes 

Data  Base 

Optimal  ft  of  observations* 

SEP1 

23  to  37 

SEP2 

18  to  22 

SEP3 

18  to  20 

SEP4 

23  to  24 

SEP5 

23  to  24 

SEP6 

23  to  24 

SEP7 

22  to  23 

SEP8 

22  to  23 

SEP? 

22  to  23 

SEP10 

22  to  24 

SEP11 

24 

SEP!  2 

24 

*  -  Determined  by  observing  where  the  adjusted  R* 
was  maximized  and  where  the  standard  deviation 
was  minimized. 


Since  an  analysis  of  each  individual  data  base  indicated  a 
range  where  this  best  number  would  exist,  and  since 
maintaining  a  different  number  of  observations  in  each  data 
base  would  complicate  the  operational  use  of  the  proposed 
methodology,  an  average  of  the  adjusted  Rs  and  an  average 
of  the  standard  deviations  were  computed.  It  was  hoped 
that  these  average  statistics  would  provide  insight  into  an 
overall  best  number  of  observations  which  could  be  used. 
Graphical  displays  of  these  averages  are  shown  in  Figures  3 
and  4. 
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FIGURE  3.  Avg  Standard  Deviation  vs  #  of  Observations 
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The  analysis  of  these  graphs  indicated  that  the 
optimal  number  of  observations  which  should  be  maintained 
in  the  data  bases  would  be  twenty-three.  However,  since 
there  is  not  a  statistically  significant  difference  between 
twenty-three  or  twenty-four,  and  since  twenty-four  < two 
years  of)  historical  observations  might  be  more  palatable 
to  managers,  two  years  of  observations  is  recommended. 

Prediction  Error  Minimization.  Although  determining 
an  optimal  number  of  observations  by  maximizing  R  and 
minimizing  standard  deviation  is  desirable,  the  primary 
purpose  of  this  phase  was  to  try  to  decrease  the  prediction 
error.  Therefore,  changes  in  the  prediction  error  for  SEP1 
through  SEP9  were  calculated  for  different  data  base  sizes. 
Data  bases  SEP10  through  SEP12  were  not  analyzed  because  of 
small  data  base  sizes.  That  is,  in  order  to  project  losses 
for  a  given  month  from  a  data  base  such  as  SEP12,  all 
entries  subsequent  to  twelve  months  prior  to  that  month 
would  have  had  to  have  been  removed.  Since  SEP12  had  only 
thirty-one  observations  at  the  time  of  this  analysis, 
removing  twelve  would  have  left  only  nineteen  for 
projecting  the  most  current  observation. 

In  order  to  accomplish  the  prediction  error 
minimization  phase,  the  data  bases  were  altered  so  that 
they  would  appear  just  as  they  would  have  if  actual 
predictions  had  been  made.  In  other  words,  to  predict  a 
month's  losses  with  SEP5,  all  data  recorded  subsequent  to 
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five  months  prior  would  be  removed  -from  that  data  base. 
Then,  using  this  modified  data  base,  different  sizes  of 
data  bases  would  be  used  to  predict  the  observed  month's 
losses.  In  most  cases,  the  number  of  observations  used 
ranged  from  twenty  to  twenty-five  since  this  was  the  area 
which  the  first  phase  of  model  investigation  had  identified 
as  optimal.  However,  just  as  with  the  small  number  problem 
associated  with  SEPiO  through  SEP12,  data  base  size  also 
reduced  the  number  of  predictions  which  could  be  made  with 
the  remaining  nine  data  bases.  Also,  even  though  it  would 
have  been  better  if  a  large  number  of  predictions  within 
each  data  base  could  have  been  estimated,  a  maximum  of  ten 
predictions  for  each  data  base  was  all  that  was 
realistically  possible.  A  comprehensive  list  of  the 
prediction  errors  for  SEP1  through  SEP9  is  in  Appendix  E. 

When  this  analysis  was  made,  two  findings  of 
significance  surfaced.  First,  the  standard  deviation  of 
the  prediction  errors  failed  to  display  a  significant 
increasing  or  decreasing  pattern  for  the  different  data 
base  ^izes.  Second,  and  perhaps  the  most  important,  was 
that  as  the  number  of  observations  in  the  data  bases 
decreased,  so  did  the  mean  of  the  errors.  In  other  words, 
the  overprediction  which  existed  when  the  number  of 
observations  was  maximized  tended  to  decrease  as  the  number 
of  observations  in  the  data  base  decreased.  However,  based 
upon  the  hypothesis  of  changing  application  patterns,  this 
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was  not  unexpected.  The  -fewer  the  observations,  the  easier 
it  is  -for  regression  analysis  to  capture  changing  trends, 
but  on  the  other  hand,  it  must  also  be  remembered  that  the 
smaller  data  base  sizes  would  result  in  larger  prediction 
intervals  as  calculated  by  regression  packages  because  the 
mean  square  error  tended  to  increase  as  the  data  base  size 
decreased.  In  essence,  i-f  small  data  base  sizes  were  to  be 
adopted,  then  the  possibility  o-f  larger  errors  would  exist, 
while  i-f  large  data  base  sizes  were  adopted,  then  the  mean 
o-f  the  loss  predictions  may  be  -further  -from  the  actual  loss 
numbers,  but  the  expected  error  interval  would  be  smaller. 

Although  this  exercise  -failed  to  provide  additional 
in-formation  which  would  be  helpful  in  identifying  an 
optimal  number  of  observations  for  predicting,  it  did 
provide  further  insight  into  the  hypothesized  cause  for  the 
overpredictions,  that  being  changing  application  submission 
patterns. 

Conclusions 

The  hypothesis  that  current  fiscal  year  separations 
can  be  predicted  by  regression  analysis  appears  to  be 
valid;  however,  problems  still  exist  in  the  methodology. 
One  such  problem  is  the  inability  to  capture  changing 
application  patterns.  Even  with  twenty-four  observations 
maintained  in  the  data  base,  the  proposed  model  appears  to 
be  slow  in  apprehending  varying  application  patterns.  In 
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fact,  had  twenty-four  observations  been  used  in  each  data 
base  when  projecting  FY82  losses,  an  additional  cumulative 
error  of  +11  would  have  occurred  in  the  prediction.  A 
comparison  of  the  original  predictions  for  FY82  and  the 
predictions  using  the  most  recent  twenty-four  observations 
for  FY82  can  be  found  below  in  Table  V: 


Table  V 


Comparison  of  FY82's  Predictions 
Maximum  Number  of  Observations  vs 
The  Most  Recent  Twenty-Four  Observations 


Oct 

Nov 

Dec 

Jan 

Feb 

Mar 

Apr 

May 

Jun 

Jul 

Aug 

Sep 

Total 

98 

97 

102 

103 

103 

83 

106 

105 

176 

105 

154 

156 

1386 

101 

100 

103 

101 

105 

85 

106 

105 

176 

104 

155 

156 

1397 

94 

99 

101 

91 

84 

73 

76 

74 

131 

117 

141 

105 

1186 

Recommendat i ons 

The  recommendation  for  this  chapter  is  simple, 
additional  research  must  be  accomplished  regarding 
modifications  which  would  improve  the  model's  ability  to 
capture  changing  patterns.  This  research  could  probably 
take  on  three  paths.  One  would  be  to  analyze  the  pattern 
of  prediction  errors  by  means  of  a  time  series  analysis 
model.  A  second  path  would  be  to  weight  the  observations 
according  to  a  subjective  assessment  of  their  importance. 
Finally,  the  third  path  would  be  to  further  analyze  the 
regression  model  methodology  itself.  Since  some 


preliminary  work  has  been  completed  in  this  area,  it  is 
r*  explained  in  more  detail. 

As  noted  be-fore,  a  modification  to  the  methodology 
must  be  developed  which  would  aid  in  identifying  changing 
application  patterns.  An  examination  of  the  proposed 
methodology  indicates  one  possible  flaw.  When  predicting 
the  twelfth  month  of  a  twelve  month  prediction,  data  which 
is  at  best  twelve  months  old  is  used.  In  essence,  there  is 
at  least  a  twenty-four  month  difference  between  the  data 
and  the  prediction.  Although  this  example  is  the  extreme 
of  the  proposed  methodology,  it  does  indicate  a  reason  for 
the  model's  inability  to  capture  changing  patterns. 
Therefore,  if  this  time  span  could  be  decreased,  the  result 
may  be  a  decrease  in  the  prediction  error. 

Within  this  area,  one  possibility  which  was  explored 
was  the  updating  of  data  bases  with  projections  from  other 
data  bases.  In  other  words,  after  the  projection  for  one 
month  out  had  been  made,  that  prediction  was  used  as  the 
dependent  variable  for  updating  SEP2.  Following  this, 
SEP2ys  two  month  out  prediction,  along  with  SEPl's 
prediction  was  then  used  to  update  the  data  base  SEP3,  with 
the  result  being  a  new  projection  for  three  months  out. 
This  process  was  continued  until  all  twelve  data  bases  had 
been  updated  and  projections  for  all  twelve  months 
recomputed. 

This  modified  data  base  update  procedure  was  tested 
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with  FY82  data  since  the  previous  methodology's  prediction 
error  -for  this  -fiscal  year  was  si  gn  i -f  i  cant  1  y  high.  The 
results  o-f  this  exercise  are  contained  below  in  Table  VI: 


Table  VI 

Modified  Model's  Prediction  Errors  <FY82> 

Oct  Nov  Dec  Jan  Feb  Mar  Apr  May  Jun  Jul  Aug  Sep 

Modified 

Proposal  101  100  103  98  102  86  99  98  161  96  123  133 

Or i gi nal 

Proposal  98  97  102  100  103  83  106  105  176  105  154  156 


Actual  94  99  101  91  84  73  76  74  131  117  141  105 


In  the  aggregate,  the  prediction  error  was  decreased  from 
approximately  1 6.9V.  to  9.6/.,  or  in  other  words,  a  43.2% 
improvement  was  realized.  However,  it  must  be  remembered 
that  this  is  but  one  sample  dealing  with  this  modification. 
Time  precluded  additional  analysis  from  being  completed. 

In  summary,  although  the  overall  results  are 
impressive,  more  analysis  should  be  completed  before  full 
scale  operational  use  is  begun.  Not  only  is  it  apparent 
that  this  methodology  has  merit,  it  is  also  apparent  that 
with  additional  research,  improved  accuracy  of  predictions 
can  in  all  probability  be  accompl  1'shed. 


III.  Time  Series  Analysis  o-f  Separation  Data 


Methodology  and  Data  Base 

An  autoregressive  integrated  moving  average  process 
<ARIMA>  model  was  fitted  to  the  separation  data  by  means  of 
Box  and  Jenkins"  techniques  (Ref  2> .  The  data  used  in  this 
analysis  was  a  ratio  of  losses  to  population  expressed  in 
percents.  The  population  itself  was  made  up  of  rated 
officers  between  their  sixth  and  nineteenth  year  of  service 
and  of  non-rated  officers  between  their  fourth  and 
nineteenth  year  of  service.  The  loss  data  used  in  this 
analysis  was  the  same  as  that  used  in  the  current  fiscal 
year  regression  analysis  except  for  the  removal  of  nonline 
loss  data.  This  removal  was  necessary  because  of 
incomplete  historical  listings  pertaining  to  nonline 
population  sizes. 

Also,  because  of  strength  reduction  programs  which 
occurred  in  the  mid-1970"s,  the  data  base  had  to  be 
restricted  to  losses  which  had  occurred  subsequent  to 
December  1976.  This  data  base  restriction  was  necessary 
since  many  losses  which  normally  would  have  occurred  in 
1979  and  1976  were  accelerated  to  1973,  1974,  and  1975 
because  of  post-Vietnam  Reduction  in  Force  <R1F>  programs. 
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Model  Identification 

QT  The  ratio  data  was  analyzed  as  a  simple  time  series 

using  a  program  written  for  the  CYBER  computer.  This 
program  was  designed  to  utilize  catalogued  subroutines  from 
the  IMSL  Library.  A  copy  of  this  program,  named  TS,  can  be 
found  in  Appendix  P.  Initially,  the  simple  and  partial 
autocorrelations  were  examined  for  significant  lags  and/or 
damped  exponential  or  sinusoidal  patterns.  The  computer 
generated  plots  of  both  autocorrel at i ons  can  be  found  in 
Figures  5  and  6.  As  can  be  seen,  the  simple 
autocorrelation  plot  has  a  distinctive  sinusoidal  pattern, 
while  the  partial  autocorrelation  plot  appears  to  have  only 
one  significant  partial  autocorrelation  at  lag  1.  This  in 
^  itself,  would  tend  to  imply  an  autoregressive  process  of 

order  I.  However,  additional  tools  for  model 

identification  were  examined  before  a  specific  model  was 
selected  for  residual  analysis. 

Following  the  autocorrelation  anaylsis,  the  computer 
generated  periodogram  table  was  examined  for  indications  of 
significant  frequencies  inherent  in  the  data.  This 
analysis  indicated  that  a  seasonal  wave  of  length  twelve 
may  be  present.  However,  this  was  not  unexpected  since 
losses  are  Known  to  increase  during  the  summer  months  and 


then  decrease  during  the  winter  months.  Therefore,  in 
order  to  test  the  significance  of  these  and  other 
periodogram  values,  an  average  periodogram  value  was 
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FIGURE  5*  Autocorrelation  Plot  for  Separation  Data 
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calculated  and  then  multiplied  by  a  value  obtained  from  a 
distribution  table  which  can  be  found  in  Fuller,  1972  (Ref 
3:350-353).  Essentially,  any  periodogram  value  which  is 
calculated  to  be  above  this  product  can  be  considered 
statistically  significant  (throughout  the  remainder  of  this 
thesis,  the  required  value  from  this  distribution  table 
will  be  referred  to  as  the  periodogram  multiple).  Since 
the  calculated  average  was  computed  to  be  .0334  and  since 
the  periodogram  multiple  for  thirty-three  periodogram 
values  is  approximately  6.04,  we  could  assume  that  any 
value  above  .2  is  significant  at  the  95X  confidence  level. 
This  by  itself  would  indicate  that  only  the  .015  freqency 
was  significant.  However,  even  though  this  frequency  is 
highly  significant,  it  may  be  the  result  of  several  other 
waves  being  superimposed  on  each  other,  or  it  may  simply  be 
pseudo  in  nature.  If  one  discounts  the  impact  which  its 
high  value  has  on  the  average,  the  twelve  month  wave  would 
probably  become  significant.  Therefore,  since  attempting 
to  remove  a  wave  of  length  thirty-three  from  the  data  would 
significantly  affect  the  number  of  data  points  left  for 
modeling,  attempts  were  made  (o  remove  the  twelve  month 
wave  from  the  data  with  hopes  that  the  resulting  equation 
would  account  for  the  thirty-three  month  wave. 

Another  tool  for  identifying  ARIMA  models,  is  R  and  S 
array  analysis.  This  methodology,  which  was  developed  by 
H.  L.  Gray,  G.  Kelly,  and  D.  Mclntire  (Ref  3),  uses 
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relationships  between  autocorrelations  to  identify  ARMA 
models  which  could  be  used  for  further  testing.  A  copy  of 
both  the  high  and  low  frequency  R  and  S  arrays  are  in 
Appendix  F.  Although  the  seasonality  of  twelve  had  not 
been  removed  from  the  data  at  this  point,  the  R  and  S 
arrays  indicated  that  possible  nonseasonal  differencing  of 
the  data  may  also  be  necessary.  The  R  and  S  arrays 
suggested  nonstat i onar i ty  because  the  values  in  the  first 
column  of  the  low  frequency  S  array  tended  to  -2. 
Corrollary  3  in  Gray,  Mclntire,  and  Kelly  (Ref  3:30>  states 
that : 

If  G|(m>*-2  when  ^=pM  or  S,<m>=0  when  f,*<-l>V,  then 
the  process  is  nonstat i onary  and  the 
characteristic  equation  has  at  least  one  root  of 
-1. 

In  other  words,  the  R  and  S  arrays  indicated  that  at  least 
one  root  of  the  equation  may  be  on  or  near  the  unit  circle. 
A  complete  listing  of  the  computer  generated  output  for 
this  phase  of  model  identification  can  be  found  in  Appendix 
F. 

Nonseasonal  Differencing  of  the  Data.  Even  though  the 
initial  periodogram  indicated  that  seasonal  differencing  of 
twelve  may  be  required,  this  phase  of  model  identification 
did  not  incorporate  seasonal  differencing,  that  is,  only 
nonseasonal  differencing  of  order  1  has  been  accomplished 
on  the  data  at  this  point. 

Following  nonseasonal  differencing  of  the  data,  the 
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previously  identified  steps  of  analysis  were 
reaccomplished.  Just  as  before,  the  simple  and  partial 
autocorrel at i ons  were  computed  and  their  respective  plots 
analyzed.  The  autocorrelation  plots  are  displayed  in 
Figures  7  and  8.  Except  for  a  sinusoidal  wave  pattern  of 
length  twelve  in  the  simple  autocorrelation  plot,  nothing 
of  significance  was  apparent,  i.e.  no  significant  lags 
except  those  associated  with  the  sinusoidal  pattern  (lags 
8,12,  and  24)  appeared  to  be  observable.  However,  even 
though  there  appeared  to  be  a  significant  sinusoidal 
pattern  in  the  autocorrelations,  the  periodogram  failed  to 
detect  any  periodicity  as  significant. 

Following  the  analyses  of  the  autocorrelations,  the  R 
and  S  arrays  were  examined.  This  analysis  suggested  that 
an  ARIMA(4,1,1)  model  may  provide  an  adequate  fit  to  the 
data.  This  possibility  was  then  further  tested  by  use  of 
the  D  statistic  (Ref  5:22-24).  This  statistic  measures 
agreement  with  the  proper  pattern  for  the  stationary 
ARMA(p,q)  process.  As  expected,  based  on  the  R  and  S  array 
analysis,  this  statistic  also  indicated  that  the  proposed 
ARIMA(4, 1 , 1 )  model  may  be  adequate. 

Finally,  the  maximum  likelihood  estimators  were 
calculated  for  the  proposed  model,  with  the  resulting 
equation  being: 
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where  X%  i  s  the  undifferenced  data,  .0003  is  the  mean  of  the 
differenced  data,  and  A*  i  s  the  random  shock  of  the  moving 
average  process.  The  mean  .0003  must  be  removed  from  the 
data  since  the  maximum  likelihood  estimators  of  the 
coefficients  are  calculated  with  the  mean  removed. 
Finally,  since  Z*  is  differenced  data,  the  equation  of 
undifferenced  data  is: 

<  1  -B)  <  1  - . 5327B- .  1 572B*  -.01 29B*  ♦  . 351  <SB4  >  Yfc  =A^  - .  7660A*.., 

<  1  -1  . 5327B+  .  3755B*  +  .  1 443B?  +  .  3645B4  - .  351  <SBr  >  Y.  =A  - .  7660A^, 

'  t  4rl 

\  “X^ -.0003 

where  X%  is  the  undifferenced  data  and  .0003  is  the  mean  of 
the  difference  data. 

After  the  calculations  were  completed,  a  residual 
analysis  of  the  model  was  performed.  A  complete  list  of 
the  computer  generated  output  'for  this  phase  of  model 
identification  can  be  found  in  Appendix  G. 

Residual  Analysis  of  ARIMA<4, 1 , 1 ) .  As  with  any 
forecasting  model,  the  adequacy  of  fit  must  be  tested.  In 
time  series  analysis,  this  entails  a  thorough  examination 
of  the  residuals  for  signs  of  significant  autocorrelations 
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or  -frequencies. 

Just  as  with  the  -first  phase  o-f  model  identification, 
residual  analysis's  first  phase  is  to  compute  the 
autocorrelations  of  the  estimated  residuals.  This  was 
accomplished  by  using  the  same  IMSL  subroutine  that 
calculated  the  autocorrelations  of  the  raw  data.  In  this 
analysis,  an  assessment  of  the  autocorrelations  suggested 
that  there  may  be  an  unaccounted-for  wave  of  length  twelve 
still  in  the  data.  Therefore,  even  if  the  remaining  tests 
prove  negative,  attempts  should  be  made  to  remove  this 
frequency. 

The  next  phase,  was  to  examine  the  Portmanteau  Lack  of 
Fit  Test  value  for  indications  of  inadequacy.  This  value, 
takes  the  estimated  autocorrelations  as  a  whole  to  test  for 
indications  of  model  inadequacy  <Ref  2:289-291).  Once  the 
value  has  been  calculated,  it  is  then  compared  against  the 
Chi-Square  Distribution  with  K-p-q  degrees  of  freedom, 
where  p  and  q  are  the  orders  of  the  ARMA  process  and  K  is 
the  number  of  autocorrelations  used  in  the  calculation  of 
the  Portmanteau  value,  which  has  been  labeled  Q.  In  this 
residual  analysis,  the  value  df  Q  was  calculated  to  be 
32.35,  with  the  associated  Chi-Square  statistic  for 
twenty-eight  degrees  of  freedom  being  approximately  41.34 
at  the  95X  confidence  level.  Therefore,  this  test  did  not 
indicate  model  inadequacy. 

The  last  phase  of  model  inadequacy  testing  involves 
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the  graphing  of  a  cumulative  periodogram.  Figure  9 
displays  this  graph.  Except  -for  jumps  between  points, 
there  does  not  appear  to  be  any  sign  of  the  model  not 
accounting  for  significant  periodic  characteristics  in  the 
ser i es. 

In  summary,  even  though  the  cumulative  periodogram  and 
the  Portmanteau  Lack  of  Fit  test  did  not  indicate  model 
inadequacy,  additional  analysis  was  accomplished  on  the 
data  so  that  the  periodicity  of  twelve  could  be  removed 
from  the  data.  Appendix  H  contains  the  computer  generated 
autocorrelation  table  and  other  test  statistics  for  this 
residual  analysis. 

Seasonal  Differencing  of  Twelve.  After  completing  the 
residual  analysis  of  the  ARIMA(4,1,1>  model,  the  original 
data  was  seasonally  differenced  by  order  one  and  of  length 
twelve.  This  data  was  then  used  for  additional  model 
identification.  A  complete  list  of  the  computer  output  for 
this  phase  is  in  Appendix  I. 

Again,  the  autocorrelations  were  first  examined  for 
signs  of  differencing  and/or  possible  model  identification. 
As  can  be  seen  from  their  pl6ts,  Figures  10  and  11,  the 
autocorrelations  have  indications  of  nonstat i onar i ty .  This 
hypothesis  was  later  reinforced  when  examination  of  the  R 
and  S  arrays  also  indicated  the  need  for  nonseasonal 
di ff erenc i ng. 

Nonseasonal _ Pi ff erenc i ng.  After  nonseasonal 
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FIGURE  10.  Autocorrelation  Plot  of  Seasonally  Differenced 

Separation  Data 
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FIGURE  11.  Partial  Autocorrelation  Plot  of  Seasonally 

Differenced  Separation  Data 
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differencing  of  the  seasonally  differenced  data  was 
completed,  the  autocorrelations,  per i odogram,  and  R  and  S 
arrays  were  computed.  As  expected,  based  upon  the  previous 
analysis,  no  additional  differencing  was  indicated.  Also, 
examination  of  the  autocorrelations  indicated  that  an 
autoregressive  process  of  order  2  may  be  adequate. 
Moreover,  both  the  low  and  high  frequency  R  and  S  arrays 
had  strong  indications  of  an  AR<2)  process  having  an 
adequate  fit.  Finally,  the  calculation  of  the  D  statistic 
also  substantiated  a  possible  AR<2)  process.  Therefore, 
the  parameters  for  this  model  were  calculated  and  the  model 
was  examined  for  inadequacies. 

Parameter  Estimation.  Using  the  IMSL  catalogued 
program  FTMXL,  the  maximum  likelihood  estimates  of  the 
coefficients  were  computed,  with  the  resulting  equation 
being: 


Zt  — .  6008«Z^,  - .  3555«ZW  +A* 


However,  it  must  be  remembered  that  Z^  has  been  both 
seasonally  differenced  by  twelve  and  nonseasonal 1 y 
differenced  by  an  order  of  i.  Taking  this  into 
consideration,  the  equation  of  nondi f f erenced  data  becomes: 


<  i-tf1)  <  1  -8)  <  1  ♦  . 6008B+  .  3555B*  >Yt  «A^ 
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Multiplying  out  the  terms  results  in 


<l-B-Brt+B*Xl  +  .6008B+.3555Bl  >Yt  =At 
<  1  - .  3992B- .  2453B1  - .  3555B*  -Btt  +  .  3992B*  ♦  .  2453B*  +  .  3555B*  )  =A^ 

Yt  »X4+.0032 

where  Xt  is  the  undi -f -f erenced  data  and  .0032  is  the  mean  of 
the  differenced  data.  Again,  as  mentioned  before,  the  mean 
of  the  differenced  data  must  be  removed  from  the  data  since 
the  program  for  calculating  the  maximum  likelihood 
coefficients  removes  the  mean  from  the  data  prior  to 
performing  its  computations.  Therefore,  when  using  the 
estimated  equation  for  predicting,  the  mean  must  first  be 
removed  from  the  data  and  then  added  back  into  the 
predictions  following  all  computations. 

Residual  Analysis  of  ARIMA<2,1 ,0>»(0,1 ,0)...  As  before, 
the  initial  step  for  residual  analysis  is  to  compute  the 
autocorrelations  for  the  estimated  residuals.  The 
residuals  are  estimated  by  subtracting  the  predicted  from 
the  actual.  Just  as  with  the  previously  examined 
AR1MA(4,1,1)  model,  the  autocorrelation  plots  had  a 
significant  autocorrelation  at  lag  12.  Therefore,  this  was 
noted  so  that  additional  attempts  could  be  made  to  remove 
the  significant  autocorrelation  following  the  completion  of 
this  residual  analysis. 
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The  next  step  in  the  analysis  was  to  examine  the 
Portmanteau  Lack  o-f  Fit  value.  For  this  model,  Q  was 
calculated  to  be  16.66,  with  the  associated  Chi  Square 
statistic  -for  twenty-five  degrees  of  freedom  being  37.65  at 
the  95%  confidence  level.  Therefore,  this  test  failed  to 
identify  inadequacy  in  the  proposed  model. 

Finally,  the  cumulative  periodogram  values  were 
computed  and  graphed.  This  graph  is  shown  in  Figure  12. 
As  can  be  seen,  there  are  no  signs  of  model  inadequacy.  In 
fact,  this  model 's  cumulative  periodogram  appears  to  have  a 
better  fit  than  does  the  one  associated  with  the 
ARIMA<4, 1 , 1 ) .  However,  this  would  not  be  unexpected  since 
this  model  can  be  viewed  as  an  overfit  when  compared  with 
the  previous  model.  A  complete  list  of  this  residual 
analysis's  computer  output  can  be  found  in  Appendix  J. 

ARIMA<2, 1 ,Q)»< 1 , 1 ,0)g  Model.  Since  the  autocorrelation 
plots  of  the  ARIMA<2, 1 ,0>*(0 , 1 ,0>(l  model  indicated  a 
significant  value  at  lag  12,  a  twelfth  order  autoregressi ve 
coefficient  was  added  to  the  model.  This  change  resulted 
in  the  following  equation: 

<  1 -B* >  < 1 -B>  < 1 ♦ .  5294B*  .  2621 B1  )  <  1  ♦  .  3742B*1  >  Y4  «A4 
Multiplying  terms  yields: 
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U-.4706B-.2673B1  -.2621B* -.6258B,l  +  .0324B*'*  .  1 673B*+  .  1 640Btf- 
. 3742B1**  .  30 0 1 B1*- .  0 240  B*- .  0 98 1 B"  >  Yt  =A^ 

Y4«X*+.0032 

where  X*  is  the  undifferenced  data  and  .0032  is  the  mean  of 
the  differenced  data. 

Residual _ Analysis  of  ARIMA<2,  1 ,0)»<  i ,  1  ,0)(jL  .  An 

examination  of  the  autocorrelation  plots,  Figures  13  and 
14f  indicated  that  for  the  first  time  the  autocorrelations 
failed  to  exceed  an  estimated  2  standard  error  band. 
Therefore,  it  appeared  that  the  estimated  residuals  were 
white  noise. 

Further,  examination  of  the  Portmanteau  Lack  of  Fit 
value  also  indicated  that  there  were  no  signs  of 
inadequacy,  i.e.,  the  value  of  Q  was  calculated  as  19.43 
with  the  associated  Chi-Square  statistic  with  alpha  equal 
to  .05  and  twenty-five  degrees  of  freedom  being  37.65. 

Finally,  the  cumulative  periodogram,  Figure  15,  was 
analyzed  for  signs  of  unmodeled  freqencies.  As  with  the 
other  models,  all  points  fell  well  within  both  the  5X  and 
25X  error  bands.  Therefore,  based  upon  the  cumulative 
periodogram,  the  Portmanteau  Lack  of  Fit  test,  and  a 
subjective  assessment  of  the  autocorrelations,  there  do  not 
appear  to  be  any  significant  signs  of  model  inadequacies. 
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FIGURE  13.  Autocorrelation  Plot  of  the  Residuals 
from  the  ARIMA(2,l,0)*(l,l,0)|r 
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Conclusions 

Although  the  ARIMA<2, 1 ,0)*<1 ,1 ,0>a  adequately  fits  the 
dataf  there  still  appears  to  be  numerous  unaccounted  for 
frequencies.  These  periodicities,  which  are  not 
statistically  significant,  have  an  observable  stairstep 
pattern.  See  Figure  15.  Therefore,  attempts  to  forecast 
will  in  all  probabi 1 i ty  result  in  short  term  errors  of  a 
magnitude  which  may  be  unacceptable.  However,  when  the 
loss  projections  are  taken  as  a  whole,  the  magnitude  of  the 
overall  error  may  be  reduced  to  the  point  where  the 
resulting  prediction  error  may  be  acceptable.  Keeping  this 
in  mind,  the  following  table,  which  compares  the  FY82 
actual  values  with  the  FY82  time  series  prediction,  was 
prepared: 


_ Table  VI 1 _ 

Time  Series  FY82  Prediction  Error 


(Data  as 

of  30  Sep  81 ) 

Month 

Actual 

FY82 

Pred 

y. 

Error 

FY83 

Pred 

Oct 

.193 

.274 

♦42  0 

.203 

Nov 

.193 

.136 

-29.5 

.058 

Dec 

.197 

.207 

♦  5.1 

.120 

Jan 

.165 

.149 

-  9.7 

.067 

Feb 

.159 

.116 

-27.0 

.031 

Mar 

.137 

.131 

-  4.4 

.048 

Apr 

.145 

.120 

-17.2 

.032 

May 

.141 

.133 

-  5.7 

.053 

Jun 

.231 

.160 

-30.7 

.081 

Jul 

.219 

.291 

♦  32.9 

.201 

Aug 

.285 

.257 

-  9.8 

.177 

Sep 

.221 

.186 

-15.8 

. 

.107 

Total 

2.286 

2.160 

-  5.5 

1.178 

Number 


1137 


1074 


-63 


587 


The  total  prediction  error  of  63  <1137-1074)  equates  to  a 
5.5%  inaccuracy.  However,  when  the  FY83  estimate 
(predicting  two  years  out)  was  examined,  the  downward  trend 
in  losses  continued  to  the  point  where  the  model  could  not 
be  considered  reliable.  In  other  words,  since  there  were 
already  more  than  400  approved  career  separations  in-system 
-for  FY83  as  of  30  September  1982,  it  would  seem  unrealistic 
to  assume  that  only  175  additional  career  separations  would 
be  submitted  throughout  FY83.  In  addition,  these  in-system 
numbers  do  not  include  the  end  of  obligation  losses  which 
would  also  be  included  in  this  category. 

As  a  final  note,  when  the  prediction  was  extended  into 
FY84,  several  months  had  negative  separation  rates.  In 
other  words,  the  downward  trend  which  the 
ARIMA<2, 1 ,0)*< 1 , 1 ,0)a  had  modeled  was  not  being  reversed, 
i.e.,  the  true  long  term  trend  was  not  being  captured. 
Therefore,  the  time  series  data  requires  additional 
analysis  before  long  term  trend  predictions  should  be 
attempted.  However,  this  is  not  to  say  that  current  fiscal 
year  loss  rates  could  not  be  calculated  for  use  as  a 
comparison  tool  with  other  prediction  techniques  such  as 
regression  analysis. 

Recommendat i ons 

The  time  series  analysis  of  separation  data  indicated 
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an  area  of  research  which  I  -feel  deserves  additional 


attention.  As  observed  in  the  initial  periodogram,  there 
appears  to  be  a  long  term  wave  -for  which  differencing  could 
not  account.  Therefore,  a  simple  Fourier  Analysis  of  the 
data  was  accomplished.  This  analysis  indicated  that  a  wave 
of  length  64  or  £5  may  be  present  in  the  data.  This 
hypothesis  is  also  strengthened  when  one  subjectively 
assesses  the  plot  of  the  separation  data  (Figure  16).  As 
can  be  seen,  the  rates  had  been  increasing  through 
mid-1979,  at  which  point  they  began  decreasing.  Since  it 
is  both  unrealistic  and  infeasible  to  assume  that  the  rates 
will  continue  to  decrease  as  the  FY83  and  FY84  time  series 
predictions  suggest,  one  would  expect  that  they  would  have 
to  bottom  out  and  then  begin  to  either  stabilize  or  climb. 
To  express  this  in  another  way,  during  FY78  and  FY79,  when 
the  economy  was  significantly  better  than  today,  those 
individuals  who  were  not  quite  satisfied  with  the  service 
were  able  to  easily  obtain  employment  outside  the  Air 
Force.  Essentially,  those  individuals  who  were  sitting  on 
the  fence  tended  to  jump  to  the  private  sector.  However, 
when  economic  conditions  rapidly  changed  during  the  years 
following  1979,  jobs  became  harder  to  obtain  and  the 
retention  rates  improved.  This  change,  therefore  tended  to 
restrict  one's  propensity  to  separate  from  the  service. 
Therefore,  it  could  reasonably  be  expected  that  when 
economic  conditions  improve,  separation  rates  will 
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FIGURE  16.  Long  Term  Trend  Analysis  of  Separation  Data 


significantly  increase. 

5T  As  everyone  knows,  to  accurately  predict  such  a  change 

is  difficult  if  not  impossible.  However,  there  are 
indications  that  hint  at  when  the  influence  of  economic 
conditions  change  the  separation  patterns  of  Air  Force 
officers.  One  easily  obtained  indicator  is  the  number  of 

DOSs  in  system.  In  essence,  DOSs  in  system  tends  to  be  a 
type  of  economic  barometer  which  measures  the  impact  which 
the  economy  is  having  on  one's  propensity  to  separate. 
Therefore,  since  the  FY83  number  in  system  is  greater  than 
last  year's  (as  measured  at  equivalent  points  in  time),  it 
could  be  assumed  that  the  economic  conditions  which 
influence  one's  propensity  to  separate  may  be  improving. 
This  hypothesis  can  be  graphically  supported,  Figure  16,  by 
adding  the  regression  analysis  prediction  to  the  end  of  the 
separation  trend  chart.  In  addition,  if  one  extends  the 
estimated  64  month  wave  beyond  the  most  recent  observation, 
it  can  be  seen  that  this  wave  and  the  regression  analysis's 
prediction  trend  patterns  tend  to  coincide.  Therefore,  my 
recommendation  is  to  reaccomplish  the  time  series  analysis 
but  begin  with  a  Fourier  Analysis  which  would  identify  and 
calculate  long  term  waves  within  the  data.  These 

calculated  waves  could  then  be  removed  from  the  data  so 

that  a  conventional  time  domain  analysis  could  be  employed. 
Once  this  analysis  is  completed,  the  long  term  wave  could 

be  projected  into  the  future  and  then  simply  added  to  the 
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predictions  provided  by  the  time  series  model 
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IV.  Regression  Analysis  of  Retirement  Application  Patterns 

Methodol oqy 

The  same  SPSS  regression  package  that  was  used  to 
model  separation  trends  was  also  used  to  model  retirement 
application  patterns.  Basically,  it  was  hoped  that  the 
same  regression  methodology  could  be  used  to  predict 
retirement  loss  patterns.  Also,  just  as  with  the 
separation  data,  the  primary  source  o-f  retirement 
application  information  was  the  FYCOPS  report  (Appendix  A) . 

Data  Base  Configuration 

In  the  previous  discussion  of  officer  separations,  it 
was  noted  that  individuals  are  required  by  Air  Force  policy 
to  submit  an  application  for  separation  at  least  180  days 
prior  to  the  date  on  which  they  request  to  be  separated. 
For  those  officers  who  are  retirement  eligible,  a  similar 
type  of  policy  is  applicable.  This  policy  states  that  all 
retirement  eligible  officers  must  submit  their  retirement 
applications  at  least  90  days  prior  to  a  requested 
retirement  date.  This  90-days  notice  is  required  so  that 
all  necessary  paperwork  and  mandatory  physicals  can  be 
completed  prior  to  the  month  in  which  the  retirement  is  to 
become  effective.  Therefore,  just  as  with  DOSs  in  system 
for  separations,  the  number  of  approved  and  in-system 
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retirements  was  used  as  the  primary  independent  variable  in 
the  retirement  analysis. 

In  addition  to  voluntary  retirements,  a  large  number 
of  the  losses  which  occur  within  a  given  -fiscal  year  are  in 
a  category  commonly  referred  to  as  mandatory  retirements. 
This  type  of  retirement  is  comprised  of  three 
subcategories:  disablity,  promotion  failure,  and  high  year 
tenure  retirements.  Even  though  mandatory  loss  patterns 
are  different  from  voluntary  retirement  patterns,  the 
system  still  records  the  anticipated  retirement  date 
several  months  prior  to  the  month  in  which  the  retirement 
is  scheduled  to  occur.  The  high  year  tenure  retirement  is 
normally  recorded  in  the  system  twelve  months  prior  to  the 
required  retirement  date,  while  the  promotion  failure 
retirement  is  usually  entered  into  the  system  immediately 
following  the  promotion  board  results.  Promotion  failure 
retirements  are  required  by  Air  Force  policy  to  occur 
within  180  days  following  the  release  of  promotion  board 
results.  The  disability  retirement  advance  notification 
is,  as  one  would  expect,  very  little.  However,  since  the 
number  of  disability  retirements  which  occur  within  any 
given  month  are  usually  less  than  ten,  their  impact  is 
negligible.  Moreover,  since  the  number  of  mandatory 
retirements  which  occur  within  any  individual  category  is 
small  (normally  less  than  ten),  the  sum  of  all  three 
categories  was  used  as  the  second  independent  variable 
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instead  o f  using  each  subcategory  as  a  separate  variable. 

The  data  base  structure  designed  -for  this  analysis  is 
essentially  the  same  as  that  which  was  used  for  the 
separation  data  bases,  i.e.,  there  are  twelve  data  bases 
each  comprised  of  information  about  the  number  of 
applications  approved  and  in-system  a  given  number  of 
months  out.  As  with  the  separation  files,  the  first  column 
of  information  in  each  data  base  is  the  dependent  variable 
accomplished  retirements.  The  second  column  of  information 
in  the  retirement  files  is  the  independent  variable 
voluntary  retirements  in-system.  The  third  column  in  each 
data  base  is  the  previously  discussed  sum  of  all  mandatory 
retirements.  The  fourth  column  in  every  file  is  a  variable 
which  time  orders  the  observations.  This  additional 
variable  was  required  since  many  of  the  data  bases' 
residuals  were  positively  autocorrel ated.  Also,  some  of 
the  data  bases  required  the  addition  of  an  indicator 
variable  which  was  labeled  policy.  This  variable  always 
appears  as  the  fifth  column  in  those  data  bases  which 
required  the  variable.  In  essence,  this  indicator  variable 
pertains  to  those  months  in  which  promotion  failure  losses 
had  a  significant  effect  on  retirements.  More  will  be 
discussed  about  this  variable  in  the  regression  results 
section. 

The  names  used  for  the  retirement  files  are  RET1 
through  RET12.  The  number  used  in  each  name  has  the  same 
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connotation  as  that  associated  with  the  separation  -files, 
i.e.,  RET1  contains  data  -for  one  month  out,  RET2  contains 
data  -for  two  months  out,  etc.  Since  a  listing  o-f  each  data 
base  is  contained  in  the  SPSS  output  (Appendix  K) ,  a 
separate  appendix  containing  only  data  base  in-formation  is 
not  included. 

Finally,  the  amount  o-f  historical  information  used  in 
the  analyses  was  restricted  by  the  amount  of  historical 
data  available.  Initially,  the  data  bases  included  data 
which  had  been  recorded  subsequent  to  September  1978. 
However,  after  the  initial  regression  analyses  were 
completed,  the  data  bases  were  restricted  to  that  loss 
information  which  had  been  recorded  after  30  September 
1979.  In  summary,  the  preliminary  analyses  indicated  that 
several  promotions/policy  changes  which  occurred  prior  to 
FY80  had  significantly  affected  the  pattern  of  retirement 
appl i cat  ions. 

Regression  Results 

Using  the  maximum  number  of  observations,  with  the 
most  recent  being  May  1982,  the  R* statistic  ranged  from  .99 
for  one  month  out  (RETl)  to  .42  for  twelve  months  out 
(RET12) .  The  adjusted  R1 ranged  from  .99  for  RETl  to  .38 
for  RETl 2.  A  summary  listing  of  these  and  other  major 
statistics  can  be  found  in  Tables  VIII  and  IX. 

Like  the  separation  analyses  which  identified  a 
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TABLE  VIII 


Regression  Summary  Statistics  (Part  A) 

Monthly  Observations  through  May  82 

FILE 

OVERALL  F 

R  SQUARE 

ADJ  R  SQUARE 

DURB I N-WAT SON 

RETl 

33644.362 

.99960 

.99957 

2.0107 

RET2 

7514. ?5? 

. 99827 

.99814 

1 .6157 

RET  3 

3431.567 

.99632 

.99603 

1.7880 

RET  4 

849.546 

. 98569 

.98453 

1 .4611 

RET5 

441 .352 

.97353 

.97132 

1.2711 

RET  6 

192.030 

.94273 

.93782 

2.3546 

RET7 

48.038 

.81830 

.80827 

1.6124 

RET 8 

23.951 

.70546 

.67600 

1 .5596 

RET? 

21.961 

.59416 

.56711 

1.5595 

RET  10 

20.513 

.58587 

.55731 

1 .3553 

RETl  1 

20.342 

.58384 

.55514 

1.2970 

RETl  2 

9.788 

.42031 

.37736 

1 .4614 

Regression  Summary  Statistics  (Part  B> 
Monthly  Observations  through  May  82 


FILE 

VARIABLE  F  STATISTICS 

»  OF  OBS 

VOL  RETS 

MAND  RETS 

TIME 

RET1 

44 

42808.75 

6177.21 

15.61 

RET  2 

43 

9288.48 

1391 .88 

29.73 

RET  3 

42 

4207.24 

766.77 

40.43 

RET4 

41 

1051.30 

164.27 

35.14 

RET5 

40 

553.09 

182.46 

36.83 

RET 6 

39 

231.78 

26.59 

I 

13.28 

RET7 

36 

113.00 

9.23 

8.75 

RET  8 

34 

42.16 

10.18 

4.60 

RET  9 

33 

31.36 

7.36 

N/A 

RET10 

32 

29.33 

8.39 

M/A 

RET11 

32 

29.76 

8.55 

N/A 

RET12 

30 

17.57 

4.97 

N/A 

significant  drop  in  the  Rl  statistic  after  SEP6,  the 
retirement's  R1  statistic  also  decreased  significantly.  It 
was  determined  that  this  decrease  was  a  result  of  two 
things.  First,  it  was  felt  that  this  decrease  reflected 
the  methodology's  inability  to  account  for  the  variability 
in  the  dependent  variable  as  the  time  span  between  the 
application  submittal  month  and  the  month  of  retirement 
increased.  Second,  and  probably  most  significant,  it  was 
felt  that  a  large  portion  of  the  decrease  was  a  result  of 
the  data  bases  not  containing  a  variable  which  reflected  a 
change  in  policy  or  the  release  of  promotion  board  results 
<po1icy  variable  was  not  used  in  the  initial  analysis). 
Therefore,  these  two  possible  explanations  were  noted  for 
future  analysis.  This  second  hypothesis  resulted  in  the 
addition  of  the  fifth  variable  policy  which  was  previously 
noted. 

In  addition  to  the  R*  analysis  of  the  regression 
results,  the  F  statistics  were  found  to  be  significant  at 
the  95X  level  for  all  twelve  data  bases.  Further, 
examination  of  the  F  statistics  for  both  the  voluntary  and 
mandatory  retirement  variables  indicated  that  they  too  were 
significant  at  the  95X  confidence  level  for  all  data  bases. 
However,  the  time  variable,  which  was  used  in  the  initial 
analyses,  was  not  found  to  be  significant  for  the  data 
bases  RET9  through  RET12. 

Finally,  the  Durbi n -Wat son  values  were  checked  for 
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signs  of  autocorrelation.  This  analysis  indicated  that 
several  data  bases  had  indications  o-f  positive 

autocorrelation.  In  essence,  it  the  error  terms  in  the 
regression  model  are  positively  autocorrel ated,  then  the 
use  o-f  the  regular  least  squares  procedure  has  -four 
important  consequences.  These  are  summarized  below  <Ref 

7x352) : 

1.  The  regular  least  squares  regression 
coefficients  are  still  unbiased,  but  no 
longer  have  the  minimum  variance  property  and 
may  be  quite  inefficient. 

2.  MSE  may  seriously  underestimate  the  variance 
of  the  error  terms. 

3.  s<bK>  calculated  according  to  the  regular 
least  squares  procedure  may  seriously 
underestimate  the  true  standard  deviation  of 
the  estimated  regression  coefficient  with 
that  procedure. 

4.  The  confidence  intervals  and  test  using  the  t 
and  F  distributions  are  no  longer  strictly 
appl i cabl e . 

Therefore,  attempts  should  always  be  made  to  remove  signs 
of  autocorrelation. 

Initially,  it  was  believed  that  the  positive 
autocorrelation  was  being  caused  by  the  residuals  which 
were  associated  with  the  FY79  data.  A  subjective 
assessment  of  these  error  terms  indicated  that  in  most  data 
bases,  the  FY79  error  terms  where  usually  positive  and 
significantly  larger  than  those  following  fiscal  year  1979. 
This  difference  was  believed  to  be  due  to  both  the 
promotion  boards  which  were  held  in  FY79  and  the  condition 
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of  the  private  sector  economy.  Therefore,  since  a 
comparison  of  the  FY79  data  points  with  subsequent 
residuals  indicated  that  they  were  outliers,  they  were 
removed  from  the  files,  i.e.,  only  data  recorded  following 
30  September  1979  were  used  in  future  analyses.  Also,  in 
addition  to  the  FY79  observation  restriction,  all  data 
bases  had  the  indicator  variable  policy  added  so  that  those 
months  which  had  promotion  failure  losses  or  a  retirement 
policy  change  could  be  identified. 

Following  the  removal  of  the  FY79  observations  and 
the  addition  of  the  policy  variable,  all  regression 
analyses  were  reaccomplished.  These  regression  results 
were  significantly  different  from  those  which  were 
originally  obtained.  The  adjusted  R* statistics  ranged  from 


.99  to  .82 

instead  of 

.99  to 

.38. 

Moreover , 

the 

remain i ng 

stat i st i cs 

(Tabl es 

X  and 

XI ) 

al so  had 

consi derabl  y 

di f ferent 

resul ts. 

The 

F 

stat i st i c 

for 

mandatory 

retirements  in  data  bases  RET8  and  RET9  failed  to  pass  a 
93 V.  confidence  level  test,  and  the  F  statistic  for  time  was 
below  the  95X  confidence  level  test  in  files  RET1 ,  and  RET 6 
through  RET12.  In  addition,  the  Just  added  policy  variable 
was  statistically  significant  in  the  data  bases  RET 6 
through  RET12.  The  policy  F  statistics  indicate  that  in 
those  data  bases  which  predict  retirements  more  than  five 
months  in  advance,  policy  changes/promotion  board  results 
have  a  significant  impact  on  the  number  of  retirements 


TABLE  X 

Regression  Summery  Statistics  (Pert  A) 
Monthly  Observations,  Oct  79  through  May  82 


FILE 

OVERALL  F 

R  SQUARE 

ADJ  R  SQUARE 

DURBIN-UATS0N 

RET1 

19533.046 

. 99952 

.99947 

1 .9993 

RET  2 

5248.449 

.99822 

.99803 

1 .7528 

RET  3 

1749.056 

. 99469 

.99412 

1 .6386 

RET4 

794.176 

.98838 

.98714 

1 .4496 

RET5 

415.041 

.97801 

. 97565 

1 .9528 

RET 6 

165.125 

.94650 

.94077 

1 .8236 

RET7 

70.470 

.88675 

.87417 

2.1492 

RET  8 

61 .500 

.87648 

.86223 

2.0095 

RET  9 

45.535 

.84010 

.82165 

1.5548 

RET10 

71.942 

.89248 

.88008 

1 .6763 

RET11 

68.372 

.88750 

.87452 

1 .5227 

RET12 

84.348 

.91009 

.89330 

1.8164 

TABLE  XI 


Regression  Summery 
Monthly  Observations, 

Statistics  (Part  B> 

Oct  79  through  May  82 

ASSOC] 

ATED  VARIABLE  F  STATISTICS 

FILE 

tt  OF  OBS 

VOL  RETS 

MAND  RETS 

POLICY  VAR 

TIME 

RET1 

32 

34135.45 

3099.75 

N/A 

2.54 

RET  2 

32 

9095.94 

772.60 

N/A 

4.88 

RET3 

32 

2998.19 

299.75 

N/A 

8.57 

RET  4 

32 

1455.80 

119.25 

N/A 

12.01 

RET5 

32 

633.04 

65.26 

N/A 

4.11 

RET  6 

32 

253.83 

22.99 

5.34 

N/A 

RET7 

31 

168.68 

5.27 

7.23 

N/A 

RET  8 

30 

46.04 

1 .48 

25.54 

N/A 

RET9 

30 

33.93 

2.58 

25.18 

N/A 

RET  10 

30 

49.84 

5.29 

69.19 

N/A 

RET11 

30 

47.33 

6.45 

69.58 

N/A 

RET12 

28 

55.44 

18.07 

132.54 

N/A 

d  r 


which  will  ultimately  occur.  Also,  the  decreasing  F  value 
for  the  time  variable  indicated  that  the  decreasing 

j 

Retirement  pattern  which  was  prevalant  when  the  FY79 

-* 

Observations  were  in  the  data  bases  is  not  as  significant 

as  before. 

•i 

i  When  the  Durbi n-Watson  values  were  checked,  it  was 

i 

found  that  those  files  whose  residuals  indicated 

autocorrelation  had  changed  somewhat.  Instead  of  nine 

| 

files  having  indications  of  autocorrelation,  only  four  data 

■  m 

bases'  Durbi n-Watson  value  were  either  in  the  inconclusive 
or  the  positive  autocorrelation  region.  However,  this 

T 

decrease  in  positively  autocorrel ated  data  bases  was 
expected  following  the  removal  of  the  FY79  observations' 
positive  residuals.  However,  since  no  obvious  reason  for 
the  remaining  positive  autocorrel at i on  was  apparent, 
r  tional  analysis  was  needed  in  hopes  of  removing  the 
Remaining  signs  of  positive  autocorrelation.  The  steps 
Involved  in  this  analysis  are  discussed  below. 


Autocorrelation  Analysis. 


Since  each  data  base's 


Composition  is  basically  the  same,  it  was  felt  that  by 

Thoroughly  analyzing  just  one  data  base,  a  hypothesis  for 
he  autocorrelation  might  be  discovered.  Therefore,  since 
§ET4's  Durbi  n-Watson  statistic  had  the  lowest  value  of  all 
|welve  data  bases,  this  file  was  chosen  for  the  extensive 
Autocorrelation  research.  A  complete  discussion  of  this 

>1 

analysis  can  be  found  in  Appendix  L. 
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In  summary,  it  was  -felt  that  positive  autocorrelation 
was  being  caused  by  retirement  application  patterns  which 
occur  within  -fiscal  years.  It  was  -found  through  a  residual 
plot  analysis,  that  except  for  FY81  the  residuals  tended  to 
change  from  negative  to  positive  as  the  fiscal  year 
progressed.  Further,  it  was  felt  that  the  FY81  residual 
pattern  was  a  result  of  the  large  pay  increase  which  was 
given  in  October  1981.  Although  this  hypothesis  could  be 
modeled,  a  degree  of  uncertainty  would  still  exist  because 
the  size  of  RET4  precluded  positive  identification  of  the 
cause.  Therefore,  retirement  predictions  produced  with 
this  methodology  should  include  a  list  of  caveats 
assoc i ated  wi th  positive  autocorrelation. 

After  the  completion  of  RET4's  residual  analysis,  two 
additional  months  of  observations  were  made  available. 
Therefore,  all  regression  results  were  reaccomplished 
following  the  addition  of  June  and  July's  observations  to 
the  data  bases.  A  list  of  the  summary  statistics  for  these 
regressions  are  in  Tables  XII  and  XIII.  As  shown,  there 
were  few  changes  in  the  R1 stat i st i cs ;  however,  the  F  values 
tended  to  take  on  a  different  meaning.  Although  RET2's 
time  variable  was  significant  in  Table  XI,  it  was  not 
statistically  significant  after  the  two  additional 
observations  were  added.  This  in  itself  may  not  seem 
important,  but  if  one  considers  the  underlying  patterns 
associated  with  retirement  applications,  one  could  possibly 


70 


TABLE  XII 


f¥ 


Regression  Summary  Statistics  (Part  A> 

Monthly  Observations,  Oct  79  through  Jul  82 

FILE 

OVERALL  F 

R  SQUARE 

ADJ  R  SQUARE 

DURB IN-WATSON 

RET1 

30074.480 

.99948 

.99945 

1 .8566 

RET  2 

7377.640 

. 99790 

.99777 

1 .5314 

RET  3 

1708.593 

.99418 

.99360 

1.5707 

RET  4 

825.885 

.98804 

.98684 

1 .4790 

RET5 

447.647 

.97815 

.97956 

1 .9473 

RET  6 

164.855 

.94281 

.93709 

1 .6447 

RET  7 

76.978 

.88843 

.87689 

2.1080 

RET  8 

67.587 

.87866 

.86566 

2.0579 

RET  9 

88.720 

.90481 

.89462 

1.7150 

RET  10 

79.378 

.89749 

.88352 

1 .7106 

RET11 

74.789 

.88905 

.87716 

1 .5583 

RET12 

82.277 

.83528 

.82351 

1 .7753 

TABLE  XIII 


Regression  Summary  Statistics  (Part  B> 
Monthly  Observations,  Oct  79  through  Jul  82 


FILE 

#  OF  OBS 

VARIABLE  F 

STATISTICS 

VOL  RETS 

MAND  RETS 

POLICY  VAR 

TIME 

RET  1 

34 

37853.78 

3210.83 

N/A 

N/A 

RET  2 

34 

9339 . 63 

720.97 

N/A 

N/A 

RET  3 

34 

3067.55 

289.46 

N/A 

6.08 

RET  4 

34 

1588.4 6 

126.27 

N/A 

13.78 

RET  5 

34 

874.81 

102.05 

N/A 

14.52 

RET6 

34 

261 .40 

24.11 

6.80 

N/A 

RET  7 

33 

187.30 

5.62 

8.11 

N/A 

RET  8 

32 

59.17 

1.50 

27.65 

N/A 

RET  9 

32 

73.54 

2.78 

61  .96 

N/A 

RET10 

32 

76.11 

5.87 

64.09 

N/A 

RETU 

32 

74.53 

7.03 

61  .49 

N/A 

RET  12 

31 

64.05 

18.11 

123.41 

N/A 

<r 


hypothesize  that  the  previous  downward  trend  in  retirements 
may  be  reversing  Or  at  least  stabilizing.  In  essence, 
these  results  strengthen  the  previously  proposed  hypothesis 
that  the  downward  trend  in  retirement  application  patterns 
may  be  reversing. 


Model  Testing 

Although  an  analysis  similar  to  the  one  used  to 
determine  an  optimal  number  o-f  observations  -for  the 
separation  analysis  would  have  also  been  desirable  in  the 
retirement  analysis,  two  things  prevented  its 
accomplishment.  First,  time  precluded  the  -full  scale 
prediction  error  minimization  which  was  conducted  in  the 
separation  analysis.  This  was  due  to  the  hundreds  o-f 
regression  runs  which  would  have  been  necessary  in  order  to 
accomplish  a  similar  analysis.  Second,  and  most  important, 
it  was  -felt  that  due  to  the  nature  of  the  autocorrelation, 
trying  to  reduce  the  number  of  observations  would  only 
exacerbate  the  positive  autocorrelation  problem.  Since  the 
residual  analysis  of  RET 4  identified  a  pattern  associated 
with  fiscal  years,  a  reduction  of  observations  may  result 
in  significant  undesirable  equations  which  would  reflect  a 
particular  year's  application  pattern  and  not  an  average 
trend.  Therefore,  the  model  testing  phase  was  reduced  to 
an  analysis  of  prediction  error  magnitude,  and  not 
prediction  error  minimization. 
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In  addition  to  the  positive  autocorrelation  problem, 
small  data  base  sizes  precluded  the  calculations  on  a  large 
scale  of  the  prediction  errors.  In  other  words,  in  order 
to  project  the  twelfth  month  o-f  FY82,  RET  1 2  would  have  had 
only  twenty  observations  in  its  data  base.  Therefore,  the 
prediction  error  phase  did  not  include  predictions 
associated  with  observations  recorded  prior  to  October 
1981.  This  self  imposed  restriction  resulted  in  a  maximum 
calculation  of  twelve  prediction  errors  for  RET1 ,  eleven 
for  RET2,  ten  for  RET3,  etc.,  until  only  one  prediction 
error  was  calculated  for  RET12.  Although  this  restriction 
severely  limited  the  ability  of  this  analysis  to  accurately 
determine  the  prediction  errors  associated  with  this 
methodology,  it  was  felt  that  additional  error  computations 
would  be  meaningless  due  to  data  base  restrictions  and 
autocorrelation  problems. 

For  this  phase  of  model  testing,  each  prediction  was 
computed  just  as  it  would  have  been  under  operational 
conditions.  The  results  of  this  exercise  are  contained  in 
Table  XIV.  As  shown,  every  data  base/s  average  prediction 
error  was  negative  except  RET6.  Using  these  results,  the 
average  error  for  a  twelve  month  period  would  be 
approximately  163. A.  However,  it  should  also  be  noted  that 
the  averages  for  RET?  through  RET12  were  heavily  weighted 
by  the  large  negative  error  associated  with  September  1982. 
Since  the  September  errors  tended  to  be  significantly 
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Table  XIV 


Retirement  Regression  Prediction  Errors 
ERROR=PREDI CT I  ON-ACTUAL 


OCT 

NOV 

DEC 

JAN 

FEB 

MAR 

APR 

MAY 

JUN 

JUL 

AUG  SEP 

81 

81 

81 

82 

82 

82 

82 

82 

82 

82 

82  82 

ACTUAL 

RETS 

341 

345 

207 

204 

250 

185 

139 

149 

207 

308 

289  295 

DATA 

BASE 

Error 

RET1 

-7 

0 

-3 

0 

-2 

-2 

-1 

-4 

-3 

-2 

2  2 

RET  2 

2 

1 

2 

4 

-3 

-1 

-3 

-8 

-4 

-21  -9 

RET  3 

2 

4 

-1 

-12 

-13 

-9 

-18 

-7 

-31  -2 

RET  4 

-14 

-14 

-2? 

-22 

-15 

-21 

1 

-15  -2? 

RET5 

5 

-18 

-17 

-14 

-2 

4 

-4  -4 

RET4 

15 

10 

8 

2 

41 

34  0 

RET7 

2 

-10 

-9 

20 

41  -51 

RET  8 

14 

2 

-24 

-8  -47 

RET? 

-14 

-8 

-22  -52 

RET10 

-7 

-2  -71 

RET11 

l  -58 

RET12 

-57 

larger  than  those  associated  with  other  months,  the  average 
expected  error  may  be  overstated.  Therefore,  in  hopes  of 
obtaining  a  better  estimate  of  the  model's  prediction 
ability,  an  FY82  prediction  was  compared  with  actual 
retirements.  Figure  13  displays  these  results. 

As  can  be  seen,  the  predicted  retirements  follow  the 
actual  retirement  pattern  extremely  well.  If  it  were  not 
for  the  large  September  error,  the  twelve  month  prediction 


woul  d 

be  off 

only 

f  ract  i  onal  1  y . 

For  this  exercise, 

the 

total 

twelve 

month 

error 

was  computed  to  be  si 

i  xty-three , 

wi  th 

90.5%  of 

the 

total 

error 

occurring  in 

the 

last 

predi ct i on . 

In 

essence 

,  the 

twelve  month 

error 

of 

sixty-three  equated  to  a  2.14'/.  inaccuracy.  In  contrast, 
had  the  initial  regressions  been  used  to  predict  FY82's 
retirements,  a  5. 88%  error  in  the  prediction  would  have 
occurred.  Therefore,  the  modifications  to  the  data  bases 
resulted  in  63.61%  improvement  in  the  prediction  error. 

Conclusions 

As  noted,  time  constraints  precluded  the  completion  of 
a  thorough  analysis  of  retirement  data.  However,  the 
results  of  those  areas  which  were  completed  were  as 
impressive  as  those  associated  with  the  separation  analysis 
except  for  the  positive  autocorrelation  problem.  Also,  in 
an  examination  of  the  prediction  errors,  there  appears  to 
be  the  possibility  of  a  significantly  larger  error 


FY  82  ACTUAL  US  PRED  RETS 


\ 


\ 


K 

* 


* 


O  «  _l« 
©  <E  CM 
Q  Pi.  3  *■ 
LU  CO  H  0) 
Q£  CM  O  (SI 

CL  w  <E  w 


l 

\ 


i 


Tw 

-j-<i 

4--) 


-H<E 


4  -T- 


\ 


4 — I — I — I — f 


■f"  Ll 


-f-o 


© 

© 

© 

© 

© 

© 

CO 

© 

© 

© 

© 

in 

© 

in 

© 

in 

(VI 

(VI 

i-i 

iH 

ODE  OOlJH'-^LUOiJIZI-tD 


FIGURE  17.  FY82  Officer  Actual  Rets  vs  Prediction 


MONTH 


occurring  than  that  which  was  computed  for  FY82.  As  can  be 
found  in  Table  XIV,  several  of  the  individual  month's 
prediction  errors  had  occurrences  of  large  deviations  from 
the  mean.  Should  several  of  these  occur  within  the  same 
fiscal  year's  prediction,  an  error  in  the  range  of  several 
hundred  may  not  be  improbable.  In  addition,  when  FY82's 
September  prediction  was  made,  the  policy  variable  was  not 
used.  If  there  had  been  knowledge  in  October  1981  that  a 
group  of  promotion  failures  would  be  required  to  retire  on 
or  before  the  month  of  September,  an  additional  197 
officers  would  have  been  added  to  the  September  prediction. 
This  addition  would  have  changed  the  prediction  from  2,879 
to  3,076,  or  instead  of  a  2.14%  error,  it  would  have  been 
reported  as  a  4. 55%  error.  However,  even  this  would 
probably  be  well  within  management  tolerances  for  a  twelve 
month  prediction. 

Recommendat i ons 

Unlike  the  separation  prediction  errors,  the 
retirement  errors  do  not  appear  to  have  a  visible  pattern. 
In  essence,  this  may  inhibit  the  ability  to  model  the 
prediction  errors  with  an  ARIMA  model.  On  the  other  hand, 
it  may  be  that  a  twelve  month  cumulative  error  may  be 
easier  to  model  since  it  appears  that  overall,  the 
prediction  errors  tend  to  the  negative  side.  It  may  be 
that  this  tendency  toward  negative  errors  is  the  result  of 
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the  decreasing  retirement  trend  which  was  previously  noted. 
In  addition  to  modeling  the  errors  by  means  of  a  time 


<r 

series  model,  it  was  felt  th?t  a  modified  update  procedure 
similar  to  the  one  proposed  in  the  separation  analysis  may 
reduce  the  negative  error  tendency.  Therefore,  a  trial  of 
this  procedure  was  accomplished.  The  results  are  displayed 
below  in  Table  XV: 


Table  XV 


Modified  Update  Procedure's  Prediction  Error 

FY82 

Month 

Actual 

Or i gi nal 

Modi f i ed 

Pred 

Pred 

Oct 

361 

354 

354 

Nov 

345 

347 

358 

Dec 

207 

209 

201 

Jan 

206 

190 

194 

Feb 

250 

255 

257 

Mar 

185 

200 

196 

Apr 

139 

141 

♦  144 

May 

149 

163 

168 

Jun 

207 

191 

193 

Jul 

308 

301 

297 

Aug  . 

289 

290 

294 

Sep 

295 

238 

238 

Total 

2942 

2879 

2874 

As  shown,  there  is  an  insignificant  difference  between  the 
two  predictions!  however,  this  is  not  to  say  that  this 
procedure  would  not  reduce  the  magnitude  of  the  errors  in 
the  long  run,  just  that  it  failed  to  provide  a  superior 
prediction  in  this  one  sample. 

Finally,  it  is  recommended  that  future  studies  include 
another  analysis  of  the  positive  autocorrelation  condition 
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which  existed  in  several  o-f  the  data  bases.  Also,  should 
positive  identification  and  removal  of  the  trends  be 
accomplished,  an  analysis  which  would  determine  the  optimal 
number  of  observations  in  each  data  base  should  be 
performed. 

In  summary,  the  methodology  seems  to  have  credence. 
However,  its  projections  and  associated  prediction 
intervals  should  be  appropriately  caveated  so  as  to  ensure 
proper  use. 
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V.  Time  Series  Analysis  o-f  Retirement  Data 


or 


Methodology  and  Data  Base 

Just  as  with  the  separation  analysis,  an  ARIMA  model 
was  fitted  to  the  retirement  data  by  means  of  Box  and 
Jenkins'  techniques.  The  data  used  in  this  analysis  was 
the  ratio  retirements  divided  by  population,  expressed  as  a 
percentage.  The  numerator  of  this  ratio  was  made  up  of 
line  officer  retirements  minus  promotion  failures.  This 
was  necessary  since  large  numbers  of  promotion  failure 
retirements  occur  approximately  six  months  following  the 
release  of  promotion  board  results.  In  other  words,  the 
temporary  surge  in  retirements  which  result  when  promotion 
board  results  are  released  destroys  the  normal  pattern  of 
retirements  which  this  analysis  attempts  to  model .  Also, 
even  though  non-line  officer  retirements  were  included  in 
the  regression  analyses,  their  removal  from  this  data  base 
was  necessary  since  complete  historical  population  sizes 
were  not  available  for  non-line  officers. 

In  addition  to  the  non-line  officer  constraint,  the 
number  of  observations  for  this  data  base  was  restricted  to 
only  those  observations  which  had  occurred  subsequent  to 
December  1976.  This  rest ict ion  was  necessary  for  two 
reasons.  First,  population  sizes  for  line  officers  were 
incomplete  prior  to  January  1977.  Second,  even  if 
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population  sizes  were  available,  use  o-f  the  additional  data 
would  be  questionable.  As  mentioned  in  the  retirement 
regression  analysis,  policy  changes  which  occurred  in  the 
mid-1970's  significantly  affected  retirement  trends.  Some 
of  these  policy  changes  included  waivers  for 
time-on-station  and  time-in-grade,  as  well  as  look-back 
options  which  benefited  those  officers  who  retired 
immediately  following  a  pay  increase. 

Model  Identification 

The  retirement  data  was  analyzed  as  a  simple  time 
series  using  the  same  programs  which  were  used  in  the 
separation  data  model  identification.  Usinc  ie  computer 
output  dealing  with  the  autocorrelation  plots  and  the 
periodogram  values,  it  was  determined  that  a  significant 
periodicity  of  length  twelve  was  inherent  in  the  data.  In 
essence,  the  analysis  of  the  simple  autocorrelation  plot 
suggested  this  periodicity  because  of  a  definite  sinusoidal 
pattern  with  peaks  at  lags  twelve  and  twenty-four.  In 
addition,  the  periodogram  analysis  found  that  a  frequency 
of  .087  (period  of  11.5)  was  statistically  significant. 
Based  upon  an  average  value  of  1.8  and  a  periodogram 
multiplier  value  of  6.077,  one  could  assume  that  any 
frequency  whose  intensity  value  was  above  10.9  would  be 
statistically  significant.  For  this  exercise,  only  the 
previously  mentioned  frequency  of  .087  was  determined  to  be 
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significant.  This  frequency  had  a  calculated  intensity 
value  of  24.6. 

Nonseasonal  Differencing  of  the  Data.  Following  the 
initial  analysis,  the  data  was  nonseasonal 1 y  differenced  by 
order  one  and  length  twelve.  This  differencing  was  then 
followed  by  a  reaccomplishment  of  the  calculations  for  the 
autocorrelations,  their  respective  plots,  and  the 
periodogram  values.  This  time,  the  examination  of  the 
simple  autocorrelation  plot  discovered  a  distinctive 
pattern  which  would  be  indicative  of  a  long  term  wave 
(Figure  18).  This  was  indicated  by  the  gradual  change  from 
positive  to  negative  autocorrelations  as  the  lag  increased 
from  one  to  twenty-four.  This  hypothesis  was  later 
strengthened  by  the  periodogram  table  which  indicated  that 
a  statistically  significant  long  term  wave  may  still  be  in 
the  data.  For  those  values  calculated,  only  the  .018 
frequency  was  statistically  significant.  This  frequency 
equates  to  a  wave  of  period  fifty-seven.  However,  since 
the  removal  of  such  a  wave  by  differencing  would  destroy 
the  data  base,  the  analysis  continued  without  additional 
differencing.  Finally,  further  analysis  of  the  partial 
autocorrelation  plot  (Figure  1?)  indicated  that  the  only 
statistically  significant  lag  was  at  one.  Therefore, 
without  considering  the  long  term  wave,  the  plots  would  be 
indicative  of  an  ARIMA( 1  , 0 ,0)*(0 , 1  ,  0>|X. 

R  and  S  Array  Analysis.  As  noted  above,  the 


83 


si  gn  i  -f  i  cant . 
value  of  24 .6 


This  -frequency  had  a  calculated  intensity 


Nonseasonal  Differencing  o-f  the  Data.  Following  the 
initial  analysis,  the  data  was  nonseasonal  1  y  differenced  by 
order  one  and  length  twelve.  This  di  -f-ferenc  i  ng  was  then 
-followed  by  a  reaccomplishment  o-f  the  calculations  -for  the 
autocorrelations,  their  respective  plots,  and  the 
periodogram  values.  This  time,  the  examination  o-f  the 
simple  autocorrelation  plot  discovered  a  distinctive 
pattern  which  would  be  indicative  o-f  a  long  term  wave 
(Figure  18).  This  was  indicated  by  the  gradual  change  -from 
positive  to  negative  autocorrelations  as  the  lag  increased 
-from  one  to  twenty— four.  This  hypothesis  was  later 
strengthened  by  the  periodogram  table  which  indicated  that 
a  statistically  significant  long  term  wave  may  still  be  in 
the  data.  For  those  values  calculated,  only  the  .018 
frequency  was  statistically  significant.  This  frequency 
equates  to  a  wave  of  period  fifty-seven.  However,  since 
the  removal  of  such  a  wave  by  differencing  would  destroy 
the  data  base,  the  analysis  cont i nued  wi thout  additional 
differencing.  Finally,  further  analysis  of  the  partial 
autocorrelation  plot  (Figure  19)  indicated  that  the  only 
statistically  significant  lag  was  at  one.  Therefore, 
without  considering  the  long  term  wave,  the  plots  would  be 
indicative  of  an  ARim(l  ,0,0>*(0,1 ,0>u. 

R  and  8  Array  Analysis.  As  noted  above,  the 
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FIGURE  19.  Partial  Autocorrelation  Plot  of  Nonseasonally 

Difference  Retirement  Data 
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autocorrelation  plots  indicated  that  an 

ARIMA<  1 ,0 ,0)*<0 , 1 ,0>tl  may  provide  an  adequate  fit.  This 
model  was  implied  because  of  the  partial  autocorrelation's 
significant  value  at  lag  i.  Therefore,  the  R  and  S  arrays 
were  examined  for  symptomatic  patterns  associated  with  this 
model.  As  hoped,  the  low  frequency  R  and  S  arrays  did 
substantiate  the  proposed  model.  This  can  be  seen  by 
examining  the  annotated  arrays  in  Appendix  N. 
Consequently,  based  upon  the  autocorrelation  plots  and  the 
R  and  S  arrays,  the  proposed  model's  coefficients  were 
calculated  so  that  a  residual  analysis  could  be  performed. 
The  following  equation  contains  the  maximum  likelihood 
estimates  for  these  coefficients! 

<l-BttXl-.614?B>Z4*At 
Multiplying  out  terms  yields! 

<  1  - .  61 49B-BP  ♦  .  61 49B1*  )  Z^=At 
Z4  «X%  -  .0460 

where  is  the  undifferenced  data  and  .0460  is  the  mean  of 

the  differenced  data.  A  complete  list  of  all  the  computer 
generated  output  for  the  model  identification  phase  of  this 
analysis  can  be  found  in  Appendix  N. 

Residual  Analysis  of  ARIMA< 1 ,0 ,0)»<0 , 1 ,0)„  .  As  discussed 
in  the  separation  analysis,  in  order  to  accomplish  the 


res i dual 


analysis,  many  o-f  the  same  steps  which  are  used  to 
identify  an  initial  model  are  repeated  in  this  analysis; 
however,  intead  of  using  the  raw  data,  the  estimated 
residuals  which  are  calculated  from  the  proposed  equation 
are  used.  For  this  residual  analysis,  the  computed 
autocorrelations  failed  to  detect  a  significant  lag.  In 
essence,  the  residuals  appeared  to  be  white  noise. 

The  next  phase  in  this  residual  analysis  was  to 


examine  the  calculated  Portmanteau 

Lack  of  Fit 

value  for 

i ndi cat i ons 

of 

model 

inadequacies. 

The  computer 

generated 

value  for 

th  i  s 

model  was  17.31. 

Therefore , 

since  the 

Chi-Square 

stat i st i c 

for  twenty-seven  degrees 

of  freedom 

and  an  alpha 

val  ue 

of  .05  was 

40.11,  it  could  not  be 

assumed 

that 

the 

calculated  Q 

value  indicated  model 

inadequacy. 

Finally,  a  cumulative  periodogram  was  plotted  for  this 
model  (Figure  20).  As  shown,  there  does  not  appear  to  be 
signs  of  a  significant  periodicity  not  being  modeled  by  the 
proposed  equation.  Therefore,  based  upon  the 
autocorrelations,  the  Portmanteau  value,  and  the  cumulative 
periodogram  plot,  the  proposed  model  does  not  appear  to 
have  signs  of  inadequacy.  A  complete  list  of  the  computer 
output  for  this  residual  analysis  can  be  found  in  Appendix 
0. 
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Hie 


Model  Prediction  Capability 


Using  data  as 

of  30  September  1981,  a 

prediction  for 

FY82  was  made  so 

that  a  comparison  could  be  made  with 

actual  loss  rates. 

The  following  table 

details  those 

resul ts: 

Table  XVI 

* 

Retirement  Time  Series  FY82  Predictions  vs  Actual 


Month 
Oc 
No 
De 
Ja 
Fe 
Ma 
Ap 
Ma 
Ju 
Ju 
Au 
Se 

Total 


Actual  Pred. 


0.94 
0.99 
1 .00 

1.82  |  1.52 

1 .56 
1.62 
1 .26 
1 .31 
1  .79 
2.68 
2.53 
2.01 


♦  31  .7 

+  12.2 


+  18.6 


1 .89 


24.86  19.71  I  -20.7 


The  twelve  month  rate  difference  of  5.15  <24.86-19.71 ) 
equates  to  an  under pr edi ct i on  of  more  than  550  retirements. 
Considering  that  2,716  line  officer  retirements  occurred  in 
FY82,  this  prediction  equates  to  an  error  of  more  than  20Z. 
Therefore,  since  it  would  be  unlikely  that  such  an 
underestimate  would  be  considered  tolerable  by  management, 
additional  analysis  should  be  conducted  in  an  attempt  to 
reduce  this  error. 


Cone  1 usions 


Although  it  appeared  that  an  adequate  model  was 
identified,  attempts  to  predict  retirements  with  the 
proposed  model  proved  discouraging.  It  would  appear  that 
the  previously  discussed  policy,  pay,  and  promotion  board 
timing  changes  injected  a  degree  of  randomness  into  the 
data  which  the  model  was  unable  to  capture.  However,  this 
would  not  be  counterintuitive  since  management  itself 
cannot  accurately  predict  pay  raises,  policy  changes,  and 
dates  for  which  promotion  boards  are  to  be  held. 
Consequently,  attempts  to  model  retirement  trends  by  use  of 
a  simple  time  series  process  will,  in  all  probability, 
continue  to  fall  short  of  the  desired  goals.  In  other 
words,  it  seems  apparent  that  a  process  of  higher 
complexity  is  needed  before  acceptable  errors  in  the 
predictions  are  achieved.  A  brief  discussion  is  presented 
below  in  the  recommendatai ons  section. 

Recommendat i ons 

Because  of  the  detected  long  term  periodicity  in  the 
data,  future  attempts  to  model  retirement  data  should 
contain  an  analysis  which  would  remove  and  project  those 
trends  from  the  data.  This  could  possibly  be  conducted  by 
the  same  procedure  which  was  discussed  in  the  separation 
analysis.  However,  even  with  an  analysis  of  long  term 
trends,  short  term  changes  in  policies  can  destroy  those 


tong  term  waves,  e.g.,  a  pa y  raise  which  is  signif icantly 
larger  than  the  observed  increases  in  the  consumer  price 
index  will  drastically  change  retirement  patterns. 
Historically,  large  numbers  o-f  individuals  have  delayed 
their  retirement  until  sometime  a-fter  large  pay  increases 
have  become  effective.  This  delay  will  in  most  cases 
result  in  larger  retirement  compensation  for  those 
individuals  who  chose  to  delay  their  retirement. 
Consequently,  the  focus  of  future  analysis  should  be  on  the 
identification  of  a  transfer  function  model,  i.e.,  one 
which  could  be  used  to  predict  the  degree  of  change  which 
pol i cy  modi f i cat i ons  inflict. 


MI .  Review,  Conclusions,  and  Recommendations 


This  chapter  will  discuss  the  results 
previous  chapters  and  compare  the  predictive 
of  the  proposed  models  with  the  AFCOPS  model. 


of  the  -four 
capabi 1 i t i es 


Review  o-f  Accomplishments 

During  the  course  o-f  this  research,  numerous  models 
were  examined  as  well  as  modifications  to  those  models. 
Below  is  a  list  o-f  the  explored  models  along  with  a  brief 
discussion  of  their  nature: 


(1) 


A  regression  model  of  separation  application 
patterns.  This  model  used  accomplished  line, 
JAG,  and  chaplain  separations  as  the 
dependent  variable,  and  DOSs  without  an  SPD 
and  DOSs  with  an  SPD  as  the  independent 
variables.  Because  of  the  consistent 
overpredi ct i on  of  this  model,  attempts  were 
made  to  identify  and  remedy  this  problem. 
This  process  included  both  a  residual 
analysis  and  a  modified  update  procedure  of 
the  methodology.  A  test  of  the  modified 
update  procedure  resulted  in  a  43. 2X 
improvement  in  the  regression  methodology's 
FY82  prediction. 


<2)  A  time  series  analysis  of  line  officer 

separation  rates.  This  model,  which  used  Box 
and  Jenkins'  techniques,  analyzed  separation 
rates  as  a  simple  time  series.  Several  ARIMA 
models  were  identified,  with  the  final 
process  chosen  being  an  ARIMAC2, 1 ,0)*<  1 , 1 ,0)^. 

<3>  A  regression  analysis  of  retirement 

application  trends.  Retirement  *nolir  ion 
trends  were  analyzed  by  regressing 
accomplished  line,  JAG,,  and  chaplain 
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retirements  into  approved  and  in-system 
voluntary  and  mandatory  retirements.  Because 
of  positive  autocorrelation  problems  in  some 
of  the  files,  one  of  the  data  bases  was 
selected  for  a  comprehensive  residual 
analysis  in  an  attempt  to  identify  the  cause 
for  the  autocorrelation. 

<4>  A  time  series  analysis  of  line  officer 

retirement  trends.  A  ratio  of  line  officer 
retirements  divided  by  the  population  and 
expressed  as  a  percentage  was  analyzed  as  a 
simple  time  series.  Several  models  were 
identified,  with  the  final  model  chosen  being 
an  ARIMAC  1 ,0,0)*(0,1 ,  0  >(l. 


Conclusions 

This  section  will  present  those  conclusions  which  are 
most  signif  icant.  First,  the  conclusions  assoc i ated  wi  th 
the  time  series  methodology  will  be  examined.  This  is  then 
followed  by  the  conclusions  associated  with  the  regression 
analyses.  Following  each  subheading,  a  brief  expanded 
discussion  of  the  major  conclusions  is  made. 

Time  Series  Approach.  Chapter  III  of  this  thesis  dealt 
with  a  time  series  analysis  of  line  officer  separation 
trends.  The  following  list  summarizes  the  conclusions 
reached  in  that  analysis: 


<1)  An  ARIMA<2, 1 ,0>*<  1  , 1 ,0)|5U  was  determined  to 
provide  the  best  fit  of  the  data.  However, 
other  models  also  provided  an  adequate  fit. 

(2)  Short  term  (monthly)  projection  accuracies 
were  unacceptable.  However,  an  FY82  <12 
month)  projection  was  within  63  <5.5/0  of  the 
actual  separations  for  that  year. 

<3)  A  long  term  periodicity,  which  is  observable 
in  the  data,  could  not  be  captured  in  the 
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time  series  model.  This  resulted  in  negative 
.  loss  rate  predictions  for  FY84  when  data  as 

of  September  1981  was  used. 


The  other  time  series  analysis  which  was . accompl i shed  in 
this  thesis  attempted  to  model  line  officer  retirement 
trends  (Chapter  V) .  The  following  list  summarizes  the 
conclusions  reached  in  that  analysis: 


<1)  An  ARIMA< 1 ,0 ,0)*(0 , 1 ,0>a  model  was  determined 
to  provide  an  adequate  fit. 

(2)  Monthly  prediction  errors  were  deemed 
unacceptable.  Errors  in  excess  of  50'/.  were 
observed  when  monthly  FY82  retirements  were 
predicted. 

(3)  Long  term  predictions  were  also  found  to  be 
unacceptable.  The  FY82  prediction  was  in 
error  by  more  than  500  <20. 7%)  retirements. 

<4>  The  model  presented  could  not  account  for 
changes  in  retirements  caused  by  promotion 
board  results,  pay  increases,  or  policy 
changes. 


Discussion .  Although  time  series  models  would  have 
the  ability  to  project  losses  beyond  twelve  months,  which 
is  the  maximum  time  frame  attributable  to  the  regression 
models  in  this  thesis,  there  are  obvious  pitfalls  inherent 
in  their  use.  First  of  all,  those  models  which  were 
identified  in  this  research  failed  to  capture  long  term 
trends.  This  failure  resulted  in  perceptible  patterns 
which  when  extended  into  future  fiscal  years  resulted  in 
negative  loss  rate  projections.  Secondly,  even  though  the 
separation  model's  FY82  prediction  was  within  management's 
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tolerable  limits,  its  -failure  to  accurately  predict  monthly 
separation  rates  (see  Table  VI I >  made  the  model  unusable 
except  as  a  tool  -for  the  comparison  o-f  yearly  loss 
projections.  In  other  words,  since  the  model 's  predictions 
-for  individual  months  would  be  expected  to  deviate 
significantly  -from  the  actual  observed  values,  it  would  be 
extremely  difficult  to  ascertain  if  <1>  the  model's  short 
term  estimates  were  in  error  but  the  long  term  trend  was 
still  valid,  or  if  (2)  the  long  term  trend  had  changed  and 
this  change  was  the  cause  for  the  short  term  errors. 
Finally,  since  those  models  which  were  presented  in  these 
analyses  do  not  use  leading  indicators,  changes  to 
predictions  which  would  result  from  changes  in  promotion 
boards,  pay  benefits,  and  policy  modifications  could  not  be 
captured  in  the  proposed  model's  estimates.  Therefore, 
this  drawback  significantly  limited  the  model's  ability  to 
predict  retirements. 

In  summary,  the  time  series  approach  as  proposed  in 
this  research  has  obvious  flaws  which  limit  its  use. 
However,  this  is  not  to  say  that  variations  in  the  models, 
the  availability  of  additional  data  at  some  future  date,  or 
the  introduction  of  leading  indicators  could  not  overcome 
many  of  the  blemishes  annotated  within  this  research. 
Regression  Approach.  Regression  analyses  of  both 

separation  (Chapter  II)  and  retirement  (Chapter  IV) 

application  trends  were  also  made.  The  following  list 
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details  the  results  of  those  analyses: 


<1>  Projections  produced  by  this  methodology  were 
extremely  accurate.  An  FY81  separation 
prediction  was  in  error  by  only  1.8%,  the 
FY82  separation  prediction  was  in  error  by 
1 6.9V.,  and  the  FY82  retirement  estimate 
missed  the  actual  retirement  number  by  2.1%. 

<2>  For  the  separation  analysis,  using  a  data 

base  comprised  o-f  the  most  recent  twenty-four 
observations  was  found  to  provide  a  better 
model,  as  compared  to  models  produced  by 
using  a  larger  number  or  smaller  number  of 
observations.  Both  the  MSE  and  the  R *  were 
optimized  for  approximately  twenty-four 
observations.  This  better  fit  would  result 
in  tighter  prediction  intervals  produced  by 
these  models. 

<3>  Although  twenty-four  observations  in  each 
data  base  was  optimal,  as  the  number  of 
observations  decreased,  the  mean  of  the 
prediction  error  tended  to  decrease,  but  the 
standard  deviation  remained  nearly  constant. 

<4>  Updating  data  bases  with  projections  produced 
by  other  data  bases  significantly  improved 
the  FY82  separation  prediction,  reducing  the 
error  to  9.6/.. 

<5)  Several  of  the  retirement  data  bases  were 
found  to  be  autocorrel ated.  This  was 
believed  to  be  caused  by  retirement  trends 
within  fiscal  years. 


Pi scussi on .  Of  the  two  approaches  examined, 
regression  analysis  appears  to  be  the  most  promising.  In 
fact,  in  the  aggregate,  the  predictions  made  were  extremely 
accurate.  When  the  regression  predictions  are  compared  to 
the  previously  used  AFCOPS  predictions  (Ref  4),  the 
improvements  are  obvious.  Table  XVII  compares  each 
methodology's  estimates. 


Table  XVII 


AFCOPS  Predi 

ctions  vs 

Regression  Predictions 

FY81 

FY82 

Methodol ogy 

Seps 

Error 

Seps 

Error 

Rets 

Error 

AFCOPS* 

+  24 .9% 

2123 

+  7? .  O'A 

3155 

+  7.2X 

AFCOPS** 

+  16. 3X 

1737 

+46. 5X 

2891 

-  1.7X 

Regression 

Actual 

1717 

1686 

+  1.8 •/. 

1386 

1186 

+  16.  r/. 

2879 

2942 

-  2.  IX 

*  Prediction  based  upon  two  years  of  historical 
loss  information 


**  Prediction  based  upon  one  year  of  historical 
loss  information 

As  noted  above,  two  different  AFCOPS  estimates  were 
prepared  for  each  fiscal  year's  prediction.  This  was  due 
to  the  changing  loss  patterns  which  were  occurring  during 
the  preceeding  few  years.  Therefore,  by  using  only  one 
year  of  loss  information,  it  was  hoped  that  a  better 
estimate  of  losses  could  be  obtained.  However,  as  can  be 
seen  in  the  table,  with  the  exception  of  the  AFCOPS  FY82 
retirement  estimate  using  only  one  year  of  historical  loss 
information,  the  regression  estimates  were  significantly 
better . 

In  summary,  use  of  the  regression  methodology  provides 
significant  improvements  in  the  predictions  of  voluntary 
separations  and  retirements  when  compared  to  the  currently 
used  AFCOPS  model .  Also,  since  the  independent  variables 
used  in  this  methodology  act  as  a  barometer  of  future 
losses,  these  models  have  the  ability  to  alter  their 
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estimates  as  economic  and  policy  conditions  affect  the 
propensity  of  Air  Force  officers  to  depart  active  duty.  In 
addition,  because  of  the  simplistic  nature  of  this 
methodology,  monthly  estimates  can  be  produced  so  that  long 
term  trends  in  the  predictive  capability  of  the  models  can 
be  analyzed.  This  ability,  which  is  not  economically 
feasible  with  the  AFCOPS  model  because  of  the  extensive 
computer  and  personnel  costs  involved  with  its  maintenance 
and  production,  gives  an  added  dimension  to  the  regression 
mode 1 s . 

Recommendat i ons 

As  elaborated  on  above,  the  regression  models  explored 
in  this  thesis  are  superior  to  the  AFCOPS  model  in 
predicting  officer  voluntary  separations  and  retirements. 

Therefore , _ it _ is _ recommended  that  the  regression 

methodology  be  adopted  for  use  as  a  predictive  tool  within 
the  personnel  management  community. 

Each  chapter  of  this  thesis  details  areas  which  this 
author  considers  needing  additional  research.  In  summary, 
it  is  felt  that  for  time  series  models  to  be  of  significant 
benefit  in  predicting  loss  trends: 

<1)  Additional  data  is  required 

(2)  An  index  of  leading  indicators  must  be 

identified  which  would  link  pay,  promotions, 
and  policy  changes  to  losses. 


(3)  A  Fourier  analysis  of  long  term  trends  must 
be  accomplished  so  that  significant  long  term 
patterns  can  be  removed  -from  the  time  series 
prior  to  the  accomplishment  o-f  a  time  series 
anal ysi s. 


Although  the  regression  models  provided  significantly 
improved  predictions  when  compared  to  the  AFCOPS  model,  the 
following  areas  should  be  further  explored: 


<1)  A  comprehensive  analysis  of  the  residual 
patterns  in  order  to  identify  further 
improvements  in  the  model.  This  could  be 
accomplished  by  time  series  analysis, 
weighting  the  observations,  or  exploring 
alternative  update  procedures. 

<2>  Additional  analysis  of  the  residual  patterns 
assocj ated  wi th  the  retirement  data.  Several 
data  bases  either  hinted  at  had  positive 
autocorrelation.  Although  this  research 
identified  a  possible  cause  for  the  residual 
pattern,  additional  research  needs  to  be 
accomplished  which  would  identify  and  capture 
the  pattern. 

<3)  Accomplish  a  full  scale  analysis  of  the 
modified  update  procedure  which  was 
identified  in  the  separation  analysis 
(Chapter  II). 
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APPENDIX  B 


Listings  o-f  the  Separation  Data  Bases 
used  in  the  Regression  Analysis 


0 


109 


SEP1 


SEP2 


-NO 

ACCOMP 

NOSPO 

SPD 

1 

29*. 

15. 

278. 

2 

34*. 

13. 

334. 

3 

274  . 

90. 

243. 

4 

27*. 

86. 

23*. 

5 

262. 

57. 

232. 

6 

.  2*8  . 

<7. 

194  . 

7 

1*9, 

13. 

149. 

8 

2*6. 

40. 

178. 

9 

17*. 

41  . 

158. 

1* 

152. 

22. 

139. 

1 1 

16*. 

IS. 

16*. 

12 

164  , 

28. 

143. 

13 

147. 

11 . 

143. 

14 

156. 

25. 

143. 

15 

256. 

77. 

235. 

16 

212. 

53. 

191. 

17 

1G3. 

49. 

148. 

18 

186. 

84. 

152. 

19 

125. 

36. 

117. 

ZB 

148. 

42. 

125. 

21 

119. 

42. 

1*4. 

22 

1*8. 

57. 

86. 

23 

114. 

47. 

88. 

24 

93. 

26. 

66. 

25 

119. 

25. 

1*5. 

2b 

123. 

49. 

1*1  . 

27 

191 . 

74. 

144. 

28 

178. 

54. 

1S9 . 

29 

154. 

49. 

128. 

3* 

94. 

53. 

74. 

31 

99. 

43. 

77. 

32 

1*1. 

46. 

77. 

33 

91. 

58. 

66. 

84. 

62. 

66. 

35 

73. 

29. 

67. 

36 

76. 

35. 

46. 

3? 

74. 

35. 

59. 

SEP3 


-NO 

ACCOMP 

NOSPD 

SPD 

1 

274. 

146. 

234. 

Z 

27*. 

141  . 

21*. 

3 

262. 

88. 

226. 

4 

2*8.  . 

67. 

187. 

5 

1*9. 

16. 

153. 

6 

2*6. 

54. 

177. 

7 

17*. 

51. 

158. 

8 

152. 

2*. 

149. 

9 

16*. 

39. 

156. 

1* 

164. 

47. 

133. 

11 

147. 

16. 

143. 

12 

156. 

31  . 

15*. 

13 

2S6. 

98. 

238. 

14 

212. 

63. 

191 . 

IS 

163. 

SB. 

154  . 

1 6 

186. 

123. 

15*. 

17 

125. 

47. 

1*9. 

1 8 

148. 

59. 

122. 

19 

115. 

69. 

93. 

2* 

1*8. 

78. 

81 . 

21 

114. 

73. 

89. 

22 

93 

32. 

82. 

23 

119. 

35. 

1*1  . 

24 

128. 

76. 

104. 

25 

191. 

11*. 

133. 

26 

178. 

97. 

145. 

27 

154. 

7*. 

1*0. 

28 

94. 

9*. 

73. 

*9 

99. 

49. 

79. 

.* 

1*1 . 

49. 

Cl  . 

31 

91. 

76. 

7*. 

3  2 

84. 

8*. 

66. 

33 

73. 

24, 

69. 

34 

76. 

85. 

45. 

3$ 

74. 

6*. 

60. 

t-NO 

ACCOM? 

1 

34*. 

2 

274. 

3 

27*. 

4 

262. 

S 

2*8 . 

6 

149. 

7 

2*6. 

8 

17*. 

9 

152. 

US 

16*. 

1 1 

164. 

12 

147. 

13 

1 56 . 

14 

256. 

15 

212. 

16 

168. 

17 

186. 

18 

125. 

19 

146. 

2* 

11  9. 

21 

1*8. 

22 

114. 

23 

93. 

24 

119. 

25 

128. 

26 

191. 

27 

178. 

28 

154. 

29 

94. 

3* 

99. 

31 

1*1  . 

32 

91  . 

33 

84. 

34 

73. 

35 

7C . 

36 

74. 

NOSPD 

SPD 

14. 

333. 

117. 

250. 

134. 

222. 

7*. 

23!  . 

S3. 

191  . 

12. 

154. 

5*. 

1SS. 

46. 

163. 

2*. 

151  . 

25. 

166. 

33. 

141. 

1  !  . 

153. 

25. 

154. 

86. 

251  . 

52. 

192. 

66. 

155. 

95. 

153. 

44. 

1  19. 

46. 

126. 

62. 

1*2. 

77. 

65. 

75. 

92. 

26. 

85. 

34. 

1*3. 

54. 

1*7  . 

1*2. 

142. 

72. 

15*. 

52. 

129. 

7*. 

77. 

47. 

81 . 

43. 

86. 

61. 

72. 

63. 

71  . 

29. 

7*. 

46. 

47. 

49. 

63. 

SEP4 


CASE* NO  ACCOM?  NOSPD 


SPD 


2 

3 

4 

5 

6 

7 

8 
3 

10 
1 1 
12 

13 

14 

15 

16 

17 

18 
19 
ZB 
Zl 
22 

23 

24 

25 

26 

27 

28 
29 
3* 

31 

32 

33 

34 


27*. 

262. 

2*8. 

J49. 

2*6. 

17*. 

152. 

16*. 

164. 

147. 
156. 
256. 
212. 
158. 
186. 
125. 

148. 
119. 
1*8. 

1  14. 

93. 
119. 
128. 
191  . 
178. 
154. 

94. 
99. 

1*1  . 
91  . 
84. 

73. 
76. 

74. 


157. 
97. 
1*1. 
22. 
59. 
63. 
23. 
45. 
61. 
2*. 
32. 
113. 
75. 
111. 
16*. 
61  . 
72. 
84. 
87. 
83. 
35. 
64. 
96. 
134. 
113. 
1*5. 
132. 
72. 
66. 
33. 
86. 
3*. 
98. 
98. 


195. 

223. 

18*. 

144. 

167. 

IS*. 

146. 
157. 
128. 
141. 

147. 
229. 
187. 
154. 
14*. 
1*4. 
111. 

88. 
79. 
86. 
79. 
!**. 
1*1  . 
141 . 
145. 
96. 
73. 
75. 
79. 
65. 
69. 
6*. 
39. 
58. 
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NUMBER  OF  POSITIVE  RESIDUALS 
NUMBER  OF  NECATIVE  RESIDUALS 
NUMBER  OF  RUNS  OF  SIGNS 
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ALL  VARIABLES  ARE  IN  THE  EQUATION. 
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SIGNIFICANCE 


SEPARATION  PROJECTIONS,  3R0  MONTH  #7/15/82.  16.31.51.  PACE 

PILE  NONAME  (CREATION  DATE  ■  #7/15/82  > 
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EXPECTED  NUMBER  OF  RUNS  OF  S1CNS  18. 
EXPCCTEO  S.O.  OF  RUN  DISTRIBUTION  2.81176 
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EXPECTED  NUMBER  OF  RUNS  OF  SICNS  18. 
EXPECTED  S.D.  OF  RUN  DISTRIBUTION  2.87*96 
UNIT  NORMAL  OEVIATE- 

2-(EXPECrCD-OBSCRVCO)/S.D.  -.52247 
PROBABILITY  OF  OBTAINING  .CE.  A8S(2>  .3**67 
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EXPECTED  NUMBER  Of  RUNS  Of  STC.*-  17. 
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EXPECTED  NUMBER  Of  RUNS  OF  SICNS  17. 
EXPECTED  S.D.  OF  RUN  DISTRIBUTION  2.78243 
UNIT  NORMAL  OCVIATE- 
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PROBABILITY  OF  OBTAININC  .CE.  ABS(Z)  .42869 
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EXPECTED  NUMBER  OF  RUNS  OF  SIGNS  IE. 
EXPECTED  S.D.  OF  RUN  DISTRIBUTION  2.66343 
UNIT  NORMAL  OEVIATE- 

Z-( EXPECTED-OBSERVED) /S.D.  -.S99S2 
PROBABILITY  OF  OBTAINING  .GE.  ABS(Z)  .27441 
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AU  VARIABLES  ARC  IN  THE  EQUATION 
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EXPECTED  NUMBER  OF  RUNS  OF  SIGNS  IB. 
EXPECTED  S.O.  OF  RUN  DISTRIBUTION  2.91176 
UNIT  NORMAL  OEVIATE- 

Z-IEXPECTED-OBSERVED)/S.D.  -.68196 
PROBABILITY  OF  OBTAINING  .GE.  ABS(Z)  .24763 
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AU  VA«IA»<CS  ARE  IN  THE  EQUATION 


NUMBER  OF  POSITIVE  RESIDUALS 
NUMBER  OF  NEGATIVE  RESIDUALS 
NUMBER  OF  RUNS  OF  SIGNS 
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EXPECTEO  NUMBER  OF  RUNS  OF  SI6NS  17. 
EXPECTEO  S.O.  OF  RUN  DISTRIBUTION  2.8*293 
UNIT  NORMAL  OEVIATE- 

2-  ( EXPECTEO -OBSERVED )  /S .  D .  .  *4866 
PROBABILITY  OF  OBTAINING  .GE.  ABS(Z)  .40*60 


NOUVnOJ  3HX  HI  3 XV  S31HVIHVA  VW 


EXPECTED  NUMBER  Of  RUNS  OF  SI6NS  16. 
EXPECTED  S.O.  OF  RUN  DISTRIBUTION  2.73414 
UNIT  NORMAL  DEVIATE- 

Z*< EXPECTED-OBSERVED! /S.O.  .37164 
PROBAB1L1TV  OF  0BTA1NIN6  .6E.  A6SIZ1  .35608 


Table  D-I 

SEP1  OBSERVATION  A^LYSIS  STATISTICS 


VAR.  F  STATS 


#  OBS 

F  STAT 

R* 

ADJ  R* 

•Imse 

NOSPD 

SPD 

D-W 

37 

1847.9? 

.99088 

.99035 

6.61 

57.33 

3554.36 

2.51 

3  6 

1646.77 

.99008 

.98948 

6.62 

56.63 

3001 .58 

2.56 

35 

1226.79 

.98713 

.98632 

6.69 

48.41 

1814.47 

2.51 

34 

1050.87 

.98546 

.98453 

6.70 

47.87 

1717.34 

2.49 

33 

861 .92 

.98289 

.98175 

6.77 

39.45 

1547.12 

2.52 

32 

717.64 

.98019 

.97883 

6.72 

38.55 

1314.44 

2.52 

31 

652.13 

.97898 

.97748 

6.7? 

37.79 

1195.03 

2.56 

30 

643.25 

.97944 

.97792 

6.84 

30.27 

1155.88 

2.41 

29 

648.70 

.98035 

.97884 

6.54 

34.70 

1144.10 

2.43 

28 

621.55 

.98029 

.97871 

6.61 

33.30 

1088.83 

2.43 

27 

601 .91 

.98045 

.  97882 

6.70 

31 .84 

1027.38 

2.33 

26 

601 .47 

.98124 

.97961 

6.66 

24.08 

972.56 

2.24 

25 

616.29 

.98246 

.98087 

6.52 

27.09 

947.20 

2.2? 

24 

585.58 

.98238 

.98071 

6.68 

19.04 

795.13 

2.28 

23 

558.63 

.98241 

.98066 

6.80 

16.80 

665.98 

2.14 

22 

402.68 

.97695 

.97453 

6.60 

19.02 

568.88 

2.23 

21 

295.4? 

.97044 

.96716 

6.77 

17.23 

396.25 

2.24 

20 

255.56 

.96781 

.96402 

6.95 

15.72 

330.97 

2.25 

1? 

201.06 

.96173 

.95695 

7.01 

14.75 

316.5? 

2.26 

18 

208.34 

.96525 

.96062 

6.88 

12.14 

319.28 

2.36 

17 

184.01 

.96335 

.95812 

7.09 

11.53 

268.30 

2.2? 

16 

176.48 

.96448 

.95901 

7.23 

10.31 

254.84 

2.39 

15 

169.17 

.96575 

.96004 

7.39 

10.32 

238.36 

2.32 

14 

158.57 

.96648 

.96038 

7.63 

9.56 

223.57 

2.27 

13 

148.22 

.96737 

.96084 

7.82 

6.08 

211.19 

2.37 

12 

133.29 

.96734 

.96008 

8.24 

3.85 

157.31 

2.33 

Table  D-III 

SEP3  OBSERVATION  ttttLYSIS  STATISTICS 


OBS 

F  STAT 

R1 

ADJ  R? 

35 

649.05 

. 97594 

.  97444 

34 

558.40 

.97299 

.97125 

33 

482.32 

.96984 

.96783 

32 

396.04 

.96468 

.96224 

31 

354.58 

.96202 

.95930 

30 

354.44 

.96331 

.96059 

29 

339.86 

.96316 

.96032 

28 

321 .37 

.96256 

.  95956 

27 

308.70 

.96258 

.95946 

26 

304.22 

.96358 

.96041 

25 

324.55 

.96722 

.96424 

24 

308.83 

.96712 

. 96399 

23 

294.30 

.96714 

.96385 

22 

210.82 

.95688 

.95234 

21 

155.28 

.94522 

.93913 

20 

207.98 

.96074 

.95612 

19 

188.66 

.95932 

.95424 

18 

182.35 

.96050 

.95523 

17 

160.11 

.95811 

.95213 

16 

148.20 

.95798 

.95152 

15 

136.84 

.95800 

.95099 

14 

125.62 

.95805 

.95043 

13 

112.59 

.95748 

.94897 

12 

101 .09 

.95738 

.94791 

11 

93.39 

.95893 

.94866 

10 

53.09 

.93816 

.92049 

Vmse 

VAR.  F 
NOSPD 

STATS 

SPO 

D-W 

9.14 

46.95 

971 .86 

2.21 

9.13 

46.22 

929.97 

2.13 

8.99 

33.00 

888.90 

2.23 

8.98 

30.86 

748.11 

2.28 

9.13 

29.77 

669.83 

2.24 

9.13 

23.81 

660.66 

2.09 

8.96 

25.83 

622.12 

2.13 

9.11 

24.28 

581 .51 

2.14 

9.27 

19.73 

541 .83 

2.14 

9.28 

16.63 

519.76 

1 .91 

8.92 

20.04 

540 . 25 

2.03 

9.12 

14.76 

478.68 

2.01 

9.29 

10.42 

416.47 

1  .99 

9.03 

10.50 

311.51 

2.03 

9.21 

7.84 

191.15 

1  .90 

7.67 

12.23 

273.91 

2.64 

7.23 

16.81 

295.86 

3.18 

7.33 

13.70 

276.26 

3.26 

7;  58 

11.92 

228.62 

3.27 

7.86 

11.07 

211.57 

3.27 

8.18 

9.93 

193.53 

3.26 

8.54 

9.13 

177.69 

3.27 

8.93 

6.59 

161 .08 

3.27 

9.41 

4.48 

126.96 

3.22 

9.73 

4.08 

117.64 

3.20 

9.99 

2.56 

86.86 

2.87 

Table  D-IV 

SEP4  OBSERVATION  ^ALYSIS  STATISTICS 


#  OBS 

F  STAT 

R* 

ADJ  R* 

34 

375.84 

.96039 

.95784 

33 

372.11 

.96125 

.95867 

32 

301 .98 

.95418 

.95102 

31 

270.42 

.95078 

.94726 

30 

263.39 

.95124 

.94763 

29 

269.68 

.95401 

.95047 

28 

254.46 

.95318 

.94943 

27 

244.04 

.95313 

.94923 

26 

247.88 

.95566 

.95181 

25 

260.06 

.95942 

.95573 

24 

249.01 

.95954 

.95569 

23 

237.15 

.95954 

.95549 

22 

155.12 

.94229 

.93622 

21 

112.43 

.92588 

.91765 

20 

135.41 

.94093 

.93398 

19 

102.27 

.92745 

.91838 

18 

96.56 

.92792 

.91831 

17 

89.26 

.92728 

.91689 

1 6 

83.66 

.92791 

.91681 

15 

77.63 

.92825 

.91629 

14 

71  .32 

.92840 

.91538 

13 

63.60 

.92712 

.91254 

12 

58.58 

.92866 

.91280 

11 

52.17 

.92879 

.91098 

10 

27.69 

.88779 

.85573 

Vmse 

VAR.  F 

STATS 

NOSPD 

SPD 

D-W 

11.06 

32.67 

673.45 

2.13 

10.29 

24.08 

713.84 

2.42 

10.22 

22.87 

584.79 

2.44 

10.40 

21 .99 

528.39 

2.44 

10.53 

18.34 

511.23 

2.27 

10.01 

22.00 

515.12 

2.47 

10.19 

21.16 

479.86 

2.47 

10.37 

17.24 

450.06 

2.45 

10.24 

14.11 

446.90 

2.28 

9.93 

16.60 

460.38 

2.36 

10.12 

11.72 

418.42 

2.36 

10.31 

7  *78 

365.84 

2.38 

10.44 

7.25 

240.62 

2.41 

10.71 

5.55 

143.31 

2.27 

9.41 

6.26 

179.00 

2.85 

9.65 

5.57 

162.77 

2.90 

9.91 

4.39 

148.49 

2.83 

9.98 

4.95 

127.57 

2.95 

10.30 

4.72 

119.15 

2.99 

10.69 

4.36 

110.55 

3.00 

11.15 

4.03 

101 .38 

3.00 

11.69 

2.60 

89.91 

2.99 

12.18 

1  .55 

77.60 

3.05 

12.81 

1.34 

68.97 

3.04 

13.46 

.92 

45.29 

2.85 

Table  D-V 


SEP5  OBSERVATION  ANALYSIS  STATISTICS 


#  OBS  F  STAT 

33  264 . 35 

32  212.91 

31  190.48 

30  195.20 

29  190. 52 

28  179.29 

27  1 71 .96 

26  180.07 

25  174.47 

24  171.14 

23  170.88 

22  112.19 

21  80.48 

20  87.21 

19  64.74 

18  60.81 

17  53.42 

16  50.08 

15  46.21 

14  42.36 

13  39.52 

12  36.03 

11  32.63 

10  17.66 


ADJ  Rl  ^MSE 


VAR.  F  STATS 
NOSPD  SPD 


.94630 

.93624 

.93154 

.93531 

.93612 

.93482 

.93477 

.93997 

.94133 

.94219 

.94471 

.92194 

.89942 

.91119 

.89002 

.89020 

.88414 

.88512 

.88509 

.88509 

.88768 

.88898 

.89080 

.83459 


.94272 

.93184 

.92665 

.93052 

.93121 

.92961 

.92933 

.93475 

. 93599 

.93669 

.93918 

.91372 

. 88825 

.90074 

.87628 

. 87556 

.86759 

.86744 

.86594 

.86420 

.86522 

.86430 

• 86350 

. 78733 


12.00 

12.06 

12.26 

12.13 
11.80 
12.02 
12.24 

11.92 

11.93 
12.10 
12.05 
12.15 
12.48 
11.54 
11.89 
12.23 
12.60 
13.00 
13.53 

14.13 
14.52 
15.20 
15.86 
16.34 


15.98 
15.25 
14.45 
11.81 
12.90 
11.89 
9.58 
7.24 
7.96 
5.13 
2.44 
2.16 
1  .85 
1  .44 
1  .26 
1 .00 
1  .05 
1  .05 
.96 
.87 
.21 
.07 
.11 
.08 


515.78 

416.90 

374.70 
382.40 
371 .00 
345.45 

325.93 

335.15 
322.39 
300.97 
281.11 

185.70 
111.07 
122.33 

105.15 
96.83 
80.17 
74.66 
68.89 

62.93 
59.16 
50.74 
46.82 
28.59 


2.82 

2.86 

2.79 

2.63 

2.75 

2.75 

2.69 

2.63 

2.66 

2.65 

2.67 

2.71 

2.56 

2.94 

2.94 

2.92 

2.95 
2.98 
2.98 

2.96 

2.93 
2.93 
2.93 
2.64 
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Table  D-VI 

SEP*  OBSERVATION  **1ALYSIS  STATISTICS 


*  OBS 

F  STAT 

R* 

ADJ  R1 

Vmse 

VAR.  F 
NOSPD 

STATS 

SPD 

D-W 

33 

247.9* 

.9429* 

.9391  * 

12.37 

20.04 

48*. 89 

2.0* 

32 

197.85 

.93172 

.92701 

12.48 

19.18 

388. *8 

2.03 

31 

178.57 

.92731 

.92211 

12. *4 

19.01 

352.2* 

2.05 

30 

184.38 

.93178 

.92*72 

12.45 

15.83 

3*2.28 

1 .84 

29 

180.59 

.93285 

.927*8 

12.09 

1*.07 

355.29 

1  .94 

28 

170.82 

.93181 

.92*3* 

12.29 

15. *7 

333.33 

1 .95 

27 

1*3.00 

.93143 

.92571 

12.55 

13.47 

314.01 

1  .95 

26 

154.08 

.93055 

.92451 

12.82 

11.94 

291 .47 

1 .91 

25 

150.33 

.93182 

.925*2 

12.87 

12.** 

278. *4 

1  .8* 

24 

151 .73 

.93528 

.92911 

12.80 

8.00 

272.19 

1 .85 

23 

154.17 

.93909 

.93300 

12. *5 

4.29 

2*1.13 

1  .82 

22 

100.59 

.91371 

.904*3 

12.77 

3.97 

1*9.97 

1 .84 

21 

71  .94 

.88880 

.87*45 

13.12 

3.39 

102.29 

1 .84 

20 

*1 .71 

.87893 

.8*4*9 

13.47 

3.18 

88.43 

1 .71 

19 

78.25 

.90724 

. 895*5 

10.92 

7.97 

129.7* 

2.53 

18 

74.82 

.90889 

.89*74 

11.14 

*.42 

120.7* 

2.50 

17 

*5.*0 

.90358 

.88981 

11.50 

*.12 

103.3* 

2.51 

16 

*0.75 

.90334 

.88847 

11.93 

5.** 

95.47 

2.51 

15 

5*.*0 

.9041* 

.88818 

12.3* 

5.25 

88.98 

2.47 

14 

53.23 

.90*35 

.88933 

12.7* 

5.12 

83.25 

2.35 

13 

54.1* 

.91548 

.89857 

12.59 

1  .71 

85.43 

2.07 

12 

50.07 

.91753 

.89921 

13.10 

1  .82 

73.49 

1  .*8 

11 

71  .8* 

.94727 

.93409 

11.02 

3.35 

108.38 

2.2* 

10 

40.05 

.919*3 

.89**7 

11.39 

3.37 

*7.23 

2.44 

Table  D-VII 

SEP7  OBSERVATION  ANALYSIS  STATISTICS 


OBS 

F  STAT 

R1 

ADJ  R1 

32 

109.96 

.88350 

.87546 

31 

104.14 

.88149 

.87303 

30 

100.73 

.88182 

.87306 

29 

88.49 

.87191 

.86206 

28 

88.03 

.87566 

.86571 

27 

85.80 

.87730 

.86707 

26 

84.51 

.88022 

.86980 

2S 

79.60 

.87858 

.86754 

24 

86.96 

.89227 

.88201 

23 

106.39 

.91409 

.90549 

22 

66.99 

.87580 

.86273 

21 

50.91 

.84978 

.83308 

20 

43.69 

.83715 

.81799 

19 

33.79 

.80858 

.78465 

18 

41 .24 

.84614 

.82562 

17 

35.97 

.83708 

.81381 

16 

33.30 

.83668 

.81155 

15 

31.84 

.84145 

.81503 

14 

30.86 

.84874 

.82124 

13 

27.86 

.84785 

.81742 

1? 

27.81 

.86075 

.82981 

11 

55.91 

.93323 

.91654 

10 

29.19 

.89292 

.86233 

Vmse 

VAR.  F 

STATS 

NOSPD 

SPD 

D-W 

16.30 

17.60 

215.13 

1  .65 

16.13 

19.22 

204.97 

1 .70 

16.39 

18.29 

197.41 

1  .71 

16.70 

17.59 

173.22 

1 .67 

16.60 

16.64 

170.85 

1 .74 

16.79 

13.51 

164.26 

1 .74 

16.83 

10.74 

158.30 

1 .70 

17.17 

10.26 

145.32 

1 .58 

16.52 

5.39 

152.76 

1  .66 

15.02 

1 .48 

175.74 

1 .70 

15.33 

1 .44 

115.99 

1 .63 

15.25 

2.14 

76.74 

1 .72 

15.62 

2.08 

65.38 

1 .66 

15.69 

2.59 

57.10 

1 .78 

14.48 

1.13 

68.39 

1  .75 

14.94 

1.12 

58.73 

1 .76 

15.50 

1  .03 

54.28 

1  .72 

15.90 

.92 

52.00 

1.62 

16.21 

1  .01 

50.23 

1.62 

16.90 

.40 

45.97 

1 .55 

17.02 

.01 

43.41 

1 .46 

12.40 

.01 

90.49 

2.09 

13.15 

.00 

50.79 

2.15 

Table  D-VIII 

SEP8  OBSERVATION  ANALYSIS  STATISTICS 


,  ,  _  VAR.  F  STATS 

#  OBS  F  STAT  R*  ADJ  F?  YMSE  NOSPD  SPD  D-W 

31  80.46  .8517?  .84121  18.04  24.07  159.29  1.95 

30  78.25  .85287  .84197  18.29  23.25  154.3?  1.95 

29  69.04  .84154  .82935  18.58  22.6?  136.0?  1.96 

28  67.45  .84365  .83115  18.62  21.77  131.95  2.02 

27  71.77  .85675  .84481  18.14  19.28  139.16  2.05 

26  67.89  .85514  .84255  18.51  17.66  129.0?  2.06 

25  63.54  .85244  .83902  18.93  16.03  117.72  2.02 

24  64.25  .85954  .84616  18.86  10.42  114.45  2.06 

23  89.75  .89975  .88973  16.97  4.15  150.51  2.21 

22  55.47  .85378  .8383?  16.62  3.85  97.54  2.20 

21  39.64  .81496  .79440  16.93  4.01  62.90  2.13 

20  34.94  .80433  .78130  17.12  3.96  56.16  2.22 

1?  25.11  .75835  .72814  17.63  3.72  43.86  2.24 

18  24.48  .76550  .73424  17.88  2.77  41.80  2.23 

17  21.35  .75313  .71786  18.40  2.60  36.33  2.23 

16  20.03  .75504  .71735  18.99  2.47  34.03  2.26 

15  18.57  .75581  .71511  19.73  2.24  31.50  2.26 

14  17.65  .76243  .71924  20.32  2.22  29.90  2.23 

13  16.35  .76575  .71891  20.96  .86  28.33  2.1? 

12  14.99  .76914  .71783  21.91  .41  24.86  1.98 

11  33.43  .89289  .86611  15.71  1.05  57.62  2.57 

10  19.88  .8502?  .80752  15.54  .90  35.74  2.43 


Table  D-IX 

SEP9  OBSERVATION  ANALYSI S  STATISTICS 


«  OBS  F  STAT 

35  133.68 
34  110.99 
33  92.63 
32  80.56 
31  71.30 
30  68.69 
29  67.11 
28  66.22 
27  84.19 
26  80.29 
25  75.36 
24  90.81 
23  110.10 
22  78.02 
21  55.87 
20  48.08 
19  35.01 
18  34.53 
17  30.37 
16  28.44 
15  26.70 
14  25.56 
13  23.85 
12  23.48 
11  28.92 
10  14.37 


Rl  ADJ  R1 

.89311  .88642 
.87746  .86956 
.86064  .85135 
.84746  .83694 
.83587  .82415 
.83576  .82359 
.83773  .82525 
.84120  .82850 
.87524  .86485 
.87472  .86382 
.87236  .86105 
.89636  .88649 
.91676  .90841 
.89146  .88003 
.86125  .84584 
.84979  .83212 
.81399  .79074 
.82158  .79779 
.*T-269  .78593 
.81394  .78532 
.81652  .78594 
.82292  .79072 
.82669  .79203 
.83917  .80343 
.87850  .84813 
.80411  .74814 


Vmse 

VAR.  F 
NOSPD 

19.27 

32.32 

19.45 

27.32 

19.33 

28.93 

18.66 

18.97 

18.99 

27.42 

19.32 

24.96 

18.80 

28.30 

18.76 

27.97 

16.92 

28.64 

17.22 

25.43 

17.58 

23.67 

16.20 

15.93 

14.79 

8.57 

14.33 

10.03 

14.66 

9.70 

15.00 

8.53 

15.47 

7.47 

15.60 

5.91 

16.02 

5.55 

16.55 

5.15 

17.10 

4.93 

17.54 

4.70 

18.03 

2.19 

18.29 

.92 

16.73 

1  .47 

17.78 

1.32 

STATS 

SPD  D-W 

253.37  1.77 

216.78  1.66 

183.71  1.54 

159.14  1.54 

141.11  1.54 

135.49  1.48 

132.29  1.66 

129.68  1.70 

163.52  1.86 

153.44  1.83 

140.66  1.68 

163.82  1.80 

186.73  1.94 

138.66  2.03 

88.98  2.05 

79.59  2.04 

62.56  2.00 

60.38  1.94 

52.96  1.91 

49.52  1.93 

46.42  1.87 

44.47  1.81 

42.42  1.72 

40.22  1.69 

50.53  2.16 

25.56  2.28 


Table  D-XI 

SEP11  OBSERVATION  ANALYSIS  STATISTICS 


OBS 

F  STAT 

Rl 

ADJ  R1 

33 

72.85 

.82925 

.81787 

32 

55.47 

.79279 

. 77850 

31 

49.67 

.78012 

.76441 

30 

48.85 

.78347 

.76743 

29 

44.06 

.77216 

.75463 

28 

41 .58 

.76884 

.75035 

27 

40.98 

.  77350 

.75462 

26 

45.55 

.79843 

.78090 

25 

43.07 

.79655 

.77805 

24 

71 .45 

.87188 

.85967 

23 

68.64 

.87283 

.86012 

22 

41.85 

.81499 

.79551 

21 

29.28 

.76486 

.73873 

20 

26.32 

.75591 

.72719 

19 

25.45 

.76080 

.73090 

18 

24.54 

.76595 

.73474 

17 

21.10 

.75089 

.71531 

16 

19.59 

.75091 

.71259 

15 

18.46 

.75470 

.71382 

14 

16.94 

.75488 

.71031 

13 

15.13 

.75163 

.70196 

12 

19.06 

.80899 

.76655 

11 

16.74 

.80719 

.75899 

10 

11.55 

.76737 

.70090 

Vmse 

VAR.  F 
NOSPD 

STATS 

SPD 

D-U 

21  .40 

24.59 

145.37 

1  .71 

21.74 

23.56 

110.32 

1 .71 

21  .98 

21  .91 

98.89 

1 .64 

22.19 

19.42 

97.01 

1 .66 

22.28 

20.01 

87.42 

1  .70 

22.64 

19.56 

82.01 

1 .66 

22.81 

17.20 

80.19 

1  .68 

21 .84 

15.62 

87.80 

1  .68 

22.22 

15.13 

81 .20 

1  .36 

18.01 

10.58 

131 .67 

1 .29 

18.27 

6.99 

119.52 

1  .26 

18.71 

6.75 

75.67 

1 .28 

19.08 

5.72 

46.53 

1  .30 

19.13 

6.37 

43.97 

1 .45 

17.54 

11.03 

46.85 

2.15 

17.86 

9.76 

44.52 

2.20 

18.48 

9.13 

38.04 

2.22 

19.15 

8.44 

35.21 

2.23 

19;77 

8.09 

33.08 

2.25 

20.64 

7.41 

30.36 

2.25 

21 .59 

4.39 

27.79 

2.13 

19.93 

2.52 

34.36 

2.53 

21 .08 

2.01 

30.60 

2.41 

19.38 

1 .75 

21.52 

2.15 

Table  D-XII 

SEP12  OBSERVATION  Af-ttLYSIS  STATISTICS 


VAR.  F  STATS 


*  OBS 

F  STAT 

R1 

ADJ  R1 

Vmse 

NOSPD 

SPD 

D-W 

31 

41  .39 

.74726 

.72921 

23.56 

25.01 

82.43 

1  .67 

30 

40.86 

.75165 

.73325 

23.76 

22.47 

81.16 

1  .69 

29 

36.48 

.73724 

.71703 

23.92 

22.80 

72.36 

1.72 

28 

34.96 

.73659 

.71552 

24.16 

22.78 

68.86 

1  .66 

27 

34.71 

.74312 

.72171 

24.29 

20.59 

67.77 

1  .71 

26 

33.93 

.74688 

.  72486 

24.47 

18.46 

65.05 

1.69 

25 

32.10 

.74478 

.72158 

24.89 

17.91 

59.94 

1  .47 

24 

43.59 

.80589 

. 78740 

22.17 

13.41 

78.96 

1  .62 

23 

42.32 

.80885 

.78974 

22.40 

9.46 

72.10 

1  .58 

22 

25.12 

.72556 

.69668 

22.78 

7.71 

45.56 

1.47 

21 

16.66 

.64929 

.61032 

23.31 

6.92 

25.54 

1 .53 

20 

13.65 

.61628 

.57113 

23.98 

6.34 

21.78 

1.52 

19 

9.74 

.54910 

.49274 

24.08 

7.05 

17.48 

1 .89 

18 

9.08 

.54774 

.48744 

24.83 

6.41 

15.95 

1.85 

17 

7.98 

.53263 

. 46587 

25.31 

5.85 

13.97 

1  .82 

16 

7.38 

.53156 

.45950 

26.27 

5.44 

12.83 

1.81 

15 

6.86 

.53340 

.45563 

27.27 

5.10 

11.88 

1 .82 

14 

6.63 

.54665 

.46423 

28.07 

4.97 

11.54 

1.91 

13 

5.84 

.53856 

.44627 

29.42 

3.09 

10.50 

1 .80 

12 

8.01 

.64038 

.56047 

27.35 

2.03 

14.29 

2.36 

11 

7.22 

.64338 

.55422 

28.67 

1  .46 

13.11 

2.32 

10 

4.38 

.55575 

.42882 

26.78 

1.04 

8.17 

2.02 
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OBSERVATIONS  •  OF  OBSERVATIONS 


•  OF  OBSERVATIONS 


SEPU  ADJ  R  SOU  US  •  OF  OBS  ^  SEPU  STAND  QEU  US  •  OF  DOS 


FIGURE  D-22 


FIGURE  D-24 


OBSERVATIONS  *  OF  OBSERVATIONS 


Table  E-I 


SEP1 

*  OF  OBSERVATIONS  vs  PREDICTION  ERRORS 
ERROR=PREDI CT I  ON-ACTUAL 


OCT 

NOV 

DEC 

JAN 

FEB 

MAR  APR 

MAY  JUN 

JUL 

81 

81 

81 

82 

82 

82  82 

82  82 

82 

ACTUAL 

LOSSES 

94 

99 

101 

91 

84 

73  76 

74  131 

117 

*  OF 

OBS 

Error 

X 

S.D. 

MAX 

4 

-3 

-4 

1 

10 

7  -15 

1  -12 

5 

.8 

8.2 

25 

4 

—  j 

-1 

3 

12 

8  -14 

3  -12 

5 

.9 

8.3 

24 

7 

-1 

-2 

4 

12 

8  -14 

3  -12 

4 

.9 

8.4 

23 

7 

-1 

-1 

4 

12 

9  -14 

3  -12 

5 

1 .2 

8.5 

22 

7 

-1 

-1 

4 

11 

8  -14 

2  -12 

5 

.9 

8.2 

21 

8 

-1 

-1 

3 

12 

8  -14 

1  -12 

5 

.9 

8.4 

20 

8 

-2 

4 

14 

-3  -17 

1  -12 

5 

-.3 

9.1 

Table  E-II 

SEP2 

41  OF 

OBSERVATIONS  vs  PREDICTION  ERRORS 

ERROR-PREDI CT I  ON-ACTUAL 

OCT 

NOV 

DEC 

JAN 

FEB 

MAR  APR 

MAY  JUN 

JUL 

81 

81 

81 

82 

82 

82  82 

82  82 

82 

ACTUAL 

LOSSES 

94 

99 

101 

91 

84 

73  76 

74  131 

117 

41  OF 

OBS 

Error 

X 

S.D. 

MAX 

7 

-2 

1 

2 

10 

6  -14 

4  -7 

-4 

.3 

7.2 

25 

10 

0 

2 

5 

13 

8  -11 

6  -7 

-4 

2.2 

7.7 

24 

10 

1 

3 

5 

14 

8  -11 

6  -8 

-3 

2.5 

7.9 

23 

11 

1 

3 

5 

14 

8  -12 

6  -7 

-3 

2.4 

8.1 

22 

11 

1 

3 

5 

14 

9  -12 

6  -7 

-4 

2.4 

8.2 

21 

11 

2 

3 

5 

13 

7  -12 

6  -4 

-4 

2.5 

7.8 

20 

12 

2 

3 

5 

13 

8  -12 

1  -4 

-3 

2.3 

7.8 
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Table  E-III 
SEP3 

M  OF  OBSERVATIONS  vs  PREDICTION  ERRORS 
ERROR=PREDI CTI ON-ACTUAL 


OCT 

NOV 

DEC 

JAN 

FEB 

MAR 

APR 

MAY 

JUN 

JUL 

81 

81 

81 

82 

82 

82 

82 

82 

82 

82 

ACTUAL 

LOSSES 

94 

99 

101 

91 

84 

73 

76 

74 

131 

117 

«  OF 

OBS 

Error 

X 

S.D 

MAX 

13 

-1 

1 

8 

13 

7 

2 

8 

-7 

0 

4.4 

6.5 

25 

13 

-2 

1 

9 

14 

10 

3 

10 

-8 

0 

5.0 

7.3 

24 

14 

-1 

2 

9 

13 

10 

3 

10 

-8 

0 

5.2 

7.1 

23 

13 

0 

3 

9 

14 

10 

2 

9 

-8 

0 

5.2 

6.9 

22 

14 

1 

3 

10 

14 

10 

2 

9 

-8 

0 

5.5 

7.1 

21 

14 

1 

3 

10 

14 

11 

2 

9 

-8 

0 

5.6 

7.1 

20 

13 

1 

3 

10 

13 

10 

2 

9 

-8 

0 

5.3 

6.8 

19 

14 

1 

3 

9 

13 

10 

1 

7 

-8 

0 

5.0 

6.8 

18 

14 

1 

3 

9 

13 

11 

-2 

6 

-7 

1 

4.9 

6.9 

17 

14 

2 

3 

9 

13 

10 

-4 

3 

-6 

2 

4.6 

6.8 

16 

13 

1 

2 

9 

11 

10 

-5 

2 

-6 

2 

3.9 

6.6 

15 

13 

0 

3 

7 

10 

8 

-10 

2 

-6 

2 

2.9 

7.1 

Table  E-IV 

SEP4 

M  OF  OBSERVATIONS  vs  PREDICTION  ERRORS 
ERROR=PREDI CTI ON-ACTUAL 


OCT 

NOV 

DEC 

JAN 

FEB 

MAR 

APR 

MAY 

JUN 

JUL 

81 

81 

81 

82 

82 

82 

82 

82 

82 

82 

ACTUAL 

LOSSES 

94 

99 

101 

91 

84 

73 

76 

74 

131 

117 

«»  OF 

OBS 

Error 

X 

S.D. 

MAX 

23 

1 

1 

9 

13 

-3 

-5 

15 

-4 

-4 

4.6 

9.8 

25 

1 

9 

15 

2 

-4 

17 

-5 

-4 

3.9 

8.8 

24 

1 

2 

10 

15 

3 

-2 

17 

-5 

-4 

4.1 

8.1 

3  10  15 

3  10  15 

3  11  16 

3  12  15 

3  12  15 

3  11  15 


-2  17 

-2  16 
•3  16 

•3  16 

-4  15 

-4  14 


«r 


Table  E-V 

SEP5 

*  OF  OBSERVATIONS  vs  PREDICTION  ERRORS 
ERROR— PREDI CT I  ON-ACTUAL 


OCT 

NOV 

DEC 

JAN 

FEB 

MAR 

APR 

MAY 

JUN  JUL 

81 

81 

81 

82 

82 

82 

82 

82 

82  82 

ACTUAL 

LOSSES 

94 

99 

101 

91 

84 

73 

76 

74 

131  117 

#  OF 

OBS 

Error 

X 

S.D. 

MAX 

32 

2 

-3 

5 

19 

1 

-6 

11 

5  -11 

5.5 

12.6 

25 

19 

2 

-4 

13 

4  -10 

4.0 

10.7 

24 

5 

21 

3 

-4 

13 

4  -10 

4.6 

10.2 

23 

-3 

6 

21 

4 

-3 

13 

3-10 

3.9 

9.8 

22 

2 

-1 

6 

21 

4 

-3 

12 

2  -10 

3.8 

9.0 

21 

32 

3 

-1 

6 

21 

4 

-3 

12 

2  -10 

6.6 

12.2 

20 

32 

3 

-1 

7 

21 

5 

-4 

12 

1  -20 

6.6 

12.4 

19 

32 

2 

-1 

6 

21 

6 

-5 

12 

-1  -10 

6.2 

12.6 

18 

30 

3 

-1 

6 

21 

5 

-5 

11 

-2  -10 

5.8 

12.1 

Table  E 

-VI 

SEP6 

u. 

o 

* 

OBSERVATIONS  vs 

PREDICTION  ERRORS 

ERROR-PREDICTION-ACTUAL 

OCT 

NOV 

DEC 

JAN 

FEB 

MAR 

APR 

MAY 

JUN 

JUL 

81 

81 

81 

82 

82 

82 

82 

82 

82 

82 

ACTUAL 

LOSSES 

94 

99 

101 

91 

84 

73 

76 

74 

131 

117 

tt  OF 

OBS 

Error 

S 

S.D. 

MAX 

17 

11 

-14 

6 

13 

10 

9 

11 

4 

-5 

6.2 

9.3 

25 

10 

11 

12 

3 

-5 

6.2 

7.2 

24 

13 

12 

10 

11 

3 

-5 

7.3 

7.0 

23 

6 

15 

12 

10 

12 

3 

-5 

7.6 

6.8 

22 

-14 

7 

15 

12 

10 

12 

3 

-5 

5.0 

9.9 

21 

11 

-12 

7 

15 

13 

10 

12 

2 

-5 

5.9 

9.1 

20 

17 

13 

-12 

7 

15 

13 

10 

12 

3 

-5 

7.3 

9.4 

19 

19 

13 

-13 

7 

15 

13 

10 

12 

1 

-6 

7.1 

10.1 

18 

19 

11 

-13 

7 

15 

12 

10 

11 

-2 

-4 

6.6 

9.9 

208 


Table  E-VII 


SEP7 

*  OF  OBSERVATIONS  vs  PREDICTION  ERRORS 
ERROR=PRED I CT I  ON-ACTUAL 


OCT 

NOV 

DEC 

JAN 

FEB 

MAR 

APR 

MAY 

JUN 

JUL 

81 

81 

81 

82 

82 

82 

82 

82 

82 

82 

ACTUAL 

LOSSES 

94 

99 

101 

91 

84 

73 

76 

74 

131 

117 

II  OF 

OBS 

Error 

X 

S.D. 

MAX 

38 

25 

-1 

9 

9 

-7 

30 

26 

10 

-6 

13.3 

15.7 

23 

-7 

29 

24 

11 

-7 

10.0 

16.9 

22 

9 

-10 

28 

24 

10 

-7 

9.0 

15.5 

21 

9 

7 

-11 

29 

23 

10 

-7 

9.6 

14.5 

20 

-1 

7 

6 

-11 

27 

22 

9 

-6 

6.5 

13.2 

19 

25 

-3 

7 

7 

-12 

27 

22 

9 

- 6 

8.4 

14.0 

18 

38 

24 

-3 

7 

6 

-12 

26 

22 

7 

-5 

11.0 

15.9 

MEAN  AND  STANDARD  DEVIATION 
FOR 

FEBRUARY  THROUGH  JULY 


<1  of  Obs 


X 


S.D 


Table  E-VIII 


SEP8 

*  OF  OBSERVATIONS  vs  PREDICTION  ERRORS 
ERROR=PREDI CT I  ON-ACTUAL 


OCT 

NOV 

DEC 

JAN 

FEB 

MAR  APR  MAY 

JUN  JUL 

81 

81 

81 

82 

82 

82 

82 

82 

82  82 

ACTUAL 

LOSSES 

94 

99 

101 

91 

84 

73 

76 

74 

131  117 

*  OF 

X 

OBS 

Error 

S.D, 

r«*x 

47 

38 

-4 

1 6 

13 

-9 

28 

31 

26  -18 

20.3 

17.5 

21 

-9 

28 

31 

26  -20 

11.2 

23.9 

20 

13 

-11 

27 

30 

30  -20 

10.5 

21.1 

19 

1 6 

12 

-11 

27 

28 

24  -16 

11.4 

18.0 

18 

-4 

15 

12  -12 

25 

28 

25  -19 

8.8 

18.: 

MEAN  AND  STANDARD  DEVIATION 
FOR 

MARCH  THROUGH  JULY 


*  of  Obs 


X 


S.D 


Table  E-IV 


SEP9 

#  OF  OBSERVATIONS  vs  PREDICTION  ERRORS 
ERROR=PRED I CT I  ON-ACTUAL 


OCT 

NOV 

DEC 

JAN 

FEB  MAR 

APR 

MAY 

JUN  JUL 

81 

81 

81 

82 

82  82 

82 

82 

82  82 

ACTUAL 

LOSSES 

94 

99 

101 

91 

84  73 

76 

74 

131  117 

#  OF 

OBS 

Error 

X 

MAX 

60 

41 

5 

11 

22  -11 

29 

29 

45  -11 

22.0 

24 

-11 

29 

26 

45  -11 

15.6 

23 

22  -9 

26 

30 

45  -10 

17.3 

22 

11 

22  -14 

30 

30 

44  -13 

15.7 

21 

5 

12 

20  -9 

30 

30 

46  -14 

18.5 

20 

41 

5 

9 

23  -8 

30 

26 

46  -16 

17.3 

19 

60 

41 

1 

12 

23  -9 

26 

25 

44  -16 

20.7 

18 

59 

39 

6 

12 

23  -14 

26 

21 

44  -16 

20.0 

17 

57 

42 

6 

12 

20  -15 

22 

21 

44  -15 

19.4 

16 

62 

42 

6 

9 

19  -17 

22 

21 

40  -15 

18.9 

MEAN  AND  STANDARD  DEVIATION 
FOR 

MARCH  THROUGH  JULY 


S.D. 

23.6 

25.3 

22.2 

22.3 
17.0 
21  .3 
24.1 
24.1 
23.9 
24.8 


tt  of  Obs  5? 


S.D 


APPENDIX  F 

Separation's  Time  Series  Analysis 
Computer  Output  <Undi fferenced  Data) 


•385  -.5*84 
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APPENDIX  H 

Residual  Analysis  o-f  Separation  Data 
using  an  ARIMA(4>ltl>  Modal 
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APPENDIX  I 

Separation's  Time  Series  Analysis 
Computer  Output  (Seasonally  Differenced  Data) 
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VON  NEUMANN  RATIO  1.65416  DURB1N-VATS0N  TEST  1.61S6S  EXPECTEO  NUMBER  Of  RUNS  Of  SIGNS  22. 

EXPECTED  S.D.  OF  RUN  DISTRIBUTION  3.2233V 

NUMBER  OF  POSITIVC  RESIDUALS  23.  UNIT  NORMAL  DEVIATE- 

NUMBER  OF  NECATIVE  RESIDUALS  2 V.  Z-(EXPECTEO-OBSERVrD>/S.O.  -.89826 

NUMBTR  OF  RUNS  OF  SICNS  19.  PROBABILITY  OF  OBTAINING  .GE.  ABS(2>  .1845? 
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ADJUSTED  A  SQUARE  .44827  RESIDUAL  3#.  154998.64912  5166.6183# 

STD  DEVIATION  71.87919  COCFF  OF  VARIASKITY  29.9  FCT 
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NOTE  -  (•)  INDICATES  ESTIMATE  CALCULATED  WITH  MEANS  SUBSTITUTED 
K  INDICATES  POINT  OUT  Of  NANCE  OF  PLOT 
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NOTE  -  (•»  INDICATES  ESTIMATE  CAlCUlATrO  WITH  MEANS  SUBSTITUTED 
R  1N0ICA1 LS  POINT  OUT  Of  RANGE  Of  PLOT 


NWMCft  or  CASES  HOTTED  32. 

HONDES  Of  2  S.O.  OUTLIERS  2.  OR  C.2S  PERCENT  Of  THE  TOTAL 

VON  NEUMANN  RATIO  I. 339(0  OURBIN-WATSON  TEST  1.29997 
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RET 4  Residu&l  Analysis 

SPSS  Output 

As  mentioned  before,  RET4'  s  Durbi  n-Watson  statistic 
indicated  the  possibility  of  positive  autocorrelation.  For 
32  observations  and  three  variables,  D  is  1.24  and  D  is 
1.65.  Because  RET4's  Durbi n-Watson  statistic  was 
calculated  to  be  1.45,  this  test  was  inconclusive 
Therefore,  supplementary  evaluation  techniques  were 
required.  These  additional  techniques  involved  time  series 
analysis,  residual  plot  analysis,  and  a  runs  test 
statistic.  The  results  from  each  analysis  are  discussed 
below. 

Runs  Test.  In  addition  to  the  Durbi n-Watson  statistic, 
SPSS  also  provides  a  Runs  Test  statistic  on  the  residuals. 
The  SPSS  output  concerning  this  statistic  follows: 


NUMBER  OF  POSITIVE  RESIDUALS  16 

NUMBER  OF  NEGATIVE  RESIDUALS  16 

NUMBER  OF  RUNS  OF  SIGNS  11 

EXPECTED  NUMBER  OF  RUNS  OF  SIGNS  17 
PROBABILITY  OF  OBSERVED  RUNS  2.4X 


As  with  the  Durbi n-Watson  Statistic,  this  nonparametr i c 
test  also  indicated  the  existence  of  positive 
autocorrelation  among  the  residuals.  Therefore,  positive 


autocorrelation  could  not  be  ruled  out,  and  additional 
weight  had  to  be  placed  upon  the  other  validation 
techniques. 

* 

Residual  Plot  Analysis 

Although  Residual  Plot  Analysis  cannot  by  itself  prove 
or  disprove  autocorrelation,  it  can  provide  insight 
concerning  the  existence  of  additional  variables  or 
polynomial  terms.  Therefore,  in  hopes  of  discovering  a 
reason  for  the  possible  autocorrelation,  residual  plots 
were  made  of  t 

1.  Time  vs.  Residuals 

2.  Accomplished  Retirements  vs.  Residuals 

3.  Voluntary  Retirements  vs.  Residuals 

4.  Mandatory  Retirements  vs.  Residuals 

These  plots  are  displayed  in  Fiqures  L-l  through  L-4. 

Since  only  the  Time  vs.  Residuals  scattergram  was 
found  to  contain  a  discernible  pattern  to  the  residuals,  it 
was  concluded  that  a  polynomial  containing  a  variable 
currently  in  the  equation  was  not  indicated.  Therefore, 
the  Time  vs.  Residuals  scattergram  was  examined  more 
closely  in  hopes  of  discovering  a  systematic  pattern  that 
could  be  explained  by  the  introduction  of  another  variable. 
However,  due  to  the  limited  size  of  the  data  base,  the 
validity  of  additional  variables  is  questionable. 

Time  vs.  Residuals.  If  the  residuals  are  broken  down  by 
fiscal  year,  a  pattern  emerges.  Fiqure  L-5,  displays  these 
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FIGURE  L-2.  RET4  Accomplished  Retirements  vs  Residuals 


FIGURE  L-3 .  RET4  Voluntary  Retirements  vs  Residuals 
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FIGURE  L-4.  RET4  Mandatory  Retirements  vs  Residuals 
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RETS  IN  SYSTEM 


FIGURE  1-5.  RET4  Time  vs  Residuals  Separated  by  Fiscal  Years 
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residuals  with  each  -fiscal  year  annotated.  As  can  be  seen, 
FY  80 ' s  residuals  tend  to  increase  in  magnitude  as  time 
passes,  FY  81 's  residuals  decrease  across  its  time 
spectrum,  and  FY  82's  residuals  are  again  increasing  as  the 
-fiscal  year  progresses. 

As  mentioned  above,  hypothesizing  a  possible 
explanation  as  to  this  occurrence,  would  be  just  that,  only 
a  hypothesis.  However,  i-f  one  considers  the  -fact  that  in 
October  1981  the  Armed  Services  received  a  14.3%  pay  raise 
(very  large  in  comparison  to  previous  years'  pay  caps),  a 
possible  explanation  emerges.  That  is,  those  individuals 
who  would  have  normally  submitted  their  retirement 
application  in  late  spring,  may  have  delayed  their 
retirement  until  a-fter  the  1  October  pay  raise  or  until  the 
-following  summer  in  order  to  capitalize  the  large  pay 
increase.  Therefore,  this  hypothesis  could  explain  the 
model's  overpredi ct i on  for  July,  August,  and  September 
1981,  and  its  underestimate  of  the  October  1981 
retirements,  as  well  as  the  overall  shift  in  the  residual 
pattern  which  occurred  in  FY  81.  However,  it  must  be 
remembered  that  this  is  merely  speculation  and  cannot  be 
validated  statistically.  Therefore,  no  further  attempt  was 
made  to  rectify  this  residual  pattern. 

Time  Series  Analysis.  Finally,  so  that  the  positive 
autocorrelation  issue  could  be  resolved,  a  time  series 
analysis  using  Box  and  Jenkin's  technique  was  performed. 
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First,  simple  and  partial  autocorrelations  -for  lags  one 
through  sixteen  were  calculated.  Fiqures  L-6  and  L-7 
display  these  results.  As  expected,  based  upon  previous 
work,  all  autocorrelations  -fall  well  within  an  approximated 
2-standard-error  band  as  calculated  using  Bartlett's 
approximation  <Ref  2s36-37>.  Therefore,  positive 
autocorrelation  could  possibly  be  ruled  out  since  no 
significant  autocorrel at i ons  of  the  residuals  exists. 

RET 4  Residual  Analysis  Conclusions.  A1 though  the 
Durbi n-Uatson  statistic  implies  the  possibility  of  positive 
autocorrelation,  all  attempts  at  either  proving  or 
correcting  the  residual  pattern  proved  fruitless.  However, 
one  must  remember  that,  since  it  could  not  be  completely 
disproved  that  positive  autocorrelation  exists,  all 
associated  confidence  intervals  must  be  used  with  an  added 
degree  of  uncertainty  concerning  their  validity.  Since 
positive  autocorrelation  destroys  the  ability  to  accurately 
determine  the  variance  associated  with  the  model,  any 
confidence  interval  associated  with  predictions  may  be 
incorrect.  Also,  because  of  the  detected  residual  pattern 
associated  with  fiscal  years,  future  use  of  this 
methodology  should  contain  an  analysis  of  out-years 
residual  patterns.  An  additional  variable  could  possibly 
be  added  to  counteract  the  increasing  or  decreasing 
residual  pattern  associated  with  a  fiscal  year.  A  copy  of 
the  SPSS  output  associated  with  this  analysis  can  be  found 
in  Appendix  M. 
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FIGURE  L-7.  RET4  Residual  Partial  Autocorrelation  Plot 
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Albert  Craig  Dremstedt  was  born  in  Evansville, 
Indiana,  on  10  April  1954  and  graduated  -from  Mt .  Vernon 
Senior  High  School  in  Mt.  Vernon,  Indiana,  in  May  1972. 
Following  two  quarters  o-f  study  at  the  University  of 
Evansville,  he  enlisted  in  the  Air  Force  on  10  April  1973 
and  was  subsequently  stationed  at  Hickam  AFB,  Hawaii,  as  a 
General  Accounting  Specialist.  In  August  1975,  he  was 
accepted  into  the  Airman  Education  and  Commissioning 
Program  (AECP)  and  was  subsequently  discharged  in  September 
o-f  the  same  year  so  that  he  could  continue  his 
undergraduate  studies  at  the  University  o-f  Evansville. 
Following  graduation  in  February  1978  with  a  BS  in  Computer 
Science,  he  was  commissioned  as  a  2nd  Lt  and  assigned  to 
the  Air  Force  Manpower  and  Personnel  Center  at  Randolph 
AFB,  Texas,  where  he  served  as  both  a  personnel  and  an 
operations  research  analyst.  In  1981,  he  was  selected  to 
attend  the  Air  Force  Institute  of  Technology  at 
Wr i ght-Patterson  AFB,  Ohio. 

He  is  married  to  the  former  Sandra  S.  Weyer  of  Mt. 
Vernon,  Indiana,  and  has  one  daughter,  Angela. 
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